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ABSTRACT 


Some of the problemsarising from maximum likelihood 
decision systems in time varying channels are solved by 
first introducing simple statistics which are functions of the 
outputs of the correlators of an n-ary detection system. 
Then methods are developed to use the statistics to a) attach 
a confidence level to each decision in a maximum likelihood 
decision system, b) control the error rate at the expense of 
data rejection, and c) define the critical region for an opti- 
mum generalized decision system. These improvements and 
optimizations are accomplished by taking advantage of the 
information already available in the sample representing the 
outputs of n-ary detection systems. The six statistics that 
are investigated are simple functions of the largest corre- 
lator output, the mean, the standard deviation, the sample 
mean, the sample variance, the next to the largest correlator 
output, and the smallest correlator output. 
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STATISTICAL TESTS FOR SIGNAL DETECTION* 


by 

James C. Morakis 
Goddard Space Flight Center 


INTRODUCTION 

Present-day detection systems employ maximum likelihood decision for correlation detectors 
or ideal observer detectors for decisions on coded messages (References 1 through 4). Under cer- 
tain conditions, maximum likelihood decision maximizes the probability of correct detection p , 
and, if the distributions of the signal and noise are known, P c can be determined (Appendix B) for 
either coherent or noncoherent systems. For a gaussian channel, the outputs of the coherent cor- 
relation detector are normally distributed with means equal to zero or A and variance equal to cr 2 , 
where A/o- = /2mE/N 0 and m is the length of the word. 


f , ( x ) 




0 -x 2 /2cr 


and 


f s ( X ) 


e -(*-A ) 2 /W 


where -oo< x <°°. 


Similarly, the distributions of the outputs of noncoherent detectors are 


MO = 


and 


f. («-) 


r 



a -(r 2 +A 2 )/ 2 ct 2 t 
- A r 



*This report was prepared previously as a thesis submitted to the Faculty of the Graduate School of the University of Maryland in 
partial fulfillment of the requirements for the degree of Doctor of Philosophy. 
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where 0 < r < oo. Under the maximum likelihood decision scheme, the largest sample point is chosen 
as the useful signal, irrespective of its relative value with respect to the value of the other sample 
points; thus under the maximum likelihood decision scheme, x s = max (x,, x 2 , • • • x n ) = x (n) . This 
function is certainly simple and powerful, but, unfortunately, it does not take full advantage of the 
information contained in the n outputs. 

For example, some of the observations that could supply additional information are the values 
x (n)> x (n-i>> X (i>> the mean^j the variance a 2 ; the sample mean x; the sample variance s 2 ; and 

a multitude of other functions of the foregoing sample. Obviously there is a limitation in regard to 
the number of statistics involving any of the (x,, • • • , x n ); consequently, to choose relatively simple 
statistics that could extract most of the information contained in the (xj, • • • , x n ), some of the tests 
used for outliers will be introduced (Reference 5). The intended application of outliers was to re- 
ject observation points that do not come from the same distribution as the rest of the sample points 
Since a measure was needed for the rejection of these points, each rejection was accompanied by a 
confidence level depending on the parent distribution of the good data. The outlier approach gives 
good results if the distribution of the contaminator (the signal in our case) is not known or if there 
is no indication that a signal is transmitted. However, if something about the signal is known, this 
knowledge can be used to modify the test for outliers and thus make it more powerful. 

As was shown earlier, the maximum likelihood decision scheme can be supplemented by meas- 
uring some function of the outputs of the correlators and, on the basis of the value of this function, 
placing a confidence level on each maximum likelihood decision. One of the drawbacks of the max- 
imum likelihood decision scheme is the inability to control the error rate. Coding systems that 
can correct up to t errors per block have word-error probability 


P W = ( 1 _P e) m ' i ’ 

i=t + l 

where P e is the bit-error probability, and m is the word length. If the error rate increases beyond 
a certain limit, the coding scheme breaks down, resulting in abnormal error rates (References 6 
and 7). To insure an upper bound on the maximum probability of error, the relationships between 
thresholds and the corresponding maximum tolerable probabilities of error will be given. These 
thresholds will be functions of the observed outputs of the correlator and will separate the critical 
region from the acceptance region in a generalized decision scheme. 

If there is no restriction on the maximum probability of error in the foregoing generalized de- 
cision scheme, the value of the threshold that will optimize the overall loss could be chosen pro- 
vided that the relative loss functions that correspond to the different types of erroneous and correct 
decisions are known. It was previously mentioned that relatively simple statistics containing most 
of the information in the sample will be searched to use them either for determining confidence 
levels on maximum likelihood decisions or to use them as thresholds for more general decision 
schemes. Some simple statistics will be analyzed for comparison. 
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In summary, this report has four main objectives. 

1. Attach a confidence level to each maximum likelihood decision, based on additional infor- 
mation that could be extracted from the data. This result could be used to determine the usefulness 
of the received data, the effectiveness of coding, and possibly the need for retransmission. 

2. Provide a technique that defines the acceptance and critical regions, based on the maximum 
tolerable error rate or minimum probability of correct decision or any other requirement which is 
a function of the probabilities of error and correct decision. 

3. Assign loss functions to the errors and correct decisions and optimize the decision scheme 
by finding the value of the statistic that minimizes the average risk function. 

4. Examine some statistics (hereinafter referred to as threshold ratios) and determine their 
relative performance under conditions of varying signal strength, number of signals, and different 
distributions. These statistics do not require any new information besides the information already 
available in n-ary detection systems. 


TESTING SIMPLE HYPOTHESIS-DECISION CRITERIA 

In general two distinct areas of statistics are applied to communications— estimation and 
hypothesis testing (References 8 and 9). Estimation is employed by communications engineers for 
the extraction of signals from noise or for the estimation of one or more of the signal parameters. 
Hypothesis testing is employed for signal detection. This technique is employed when some in- 
formation is known about the signal. The philosophy of the difference between estimation and 
hypothesis testing reveals a very important point— that one should search for tests that utilize as 
much of the information contained in the sample as possible. 

Hypothesis testing is a decision process. The parameter space is divided into two subspaces. 
The parameter space under the null hypothesis H 0 is <y, and Q-co is the parameter space under the 
alternative hypothesis H 1# The sample space X is also partitioned into the critical region X c and the 
acceptance region X -x c . The critical region is used to make the decision d on whether to accept 
or reject H 0 . A typical example of choosing the decision space is to make decision d l (reject H 0 ) 
if x eX c and d 0 (accept H 0 ) if x/X c . Although this choice of d 0 and d l is the logical choice, one is 
not restricted to this decision combination (Reference 8). Thus, one can consider a number of 
different decision strategies and choose the strategy that proves to be the least costly. To ac- 
complish this, a cost function must be assigned to each decision-parameter pair. In simple 
hypothesis testing, there are two decisions (two sample spaces) and two parameter spaces, thus 
yielding the following four cost functions. 

Cj ( d x ; 6 ) the cost of accepting when # e fi - a; 

C 2 (d x ; # ) the cost of accepting when # e co 

C 3 (d 0 ; e ) the cost of accepting H 0 when# e a> 

C 4 (d 0 ; # ) the cost of accepting H 0 when# e fi - & 
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If a is defined as the probability of rejecting H 0 when 6 e w and p the probability of rejecting H 0 
when 0 e 0. - co 9 or p(x e Xje e 0 -co), then the expected cost (also referred to as the expected loss or 
as the risk function) is given by 


r (d; 6 q ) - C 2 a + C 3 (1-a); r(d; 6 J - - C 1 /3 + C 4 (1-/3) . 

The term a is sometimes referred to as the size, the type I error, or the false alarm probability; 
l - p is referred to as the type n error, and p is the power of the test. 

For example, consider the case where the signal is either gaussian noise or useful signal. The 
parameter space ft consists of the two points n = 0, a 2 = l and /z = A, a 2 = l ; ^is the point p = 0, 
cr 2 - 1 ; and fi - oj is the point ^ - A, cr 2 - 1 . Letting the critical region be all points such that 
x > A/2 is equivalent to deciding that the signal is present if x > A/2 , and that the signal is absent if 
x <A/2. Four different cases are thus generated: 

x > A/2 and fj, - A, 
x > A/2 and fj. = 0, 
x < A/2 and /x = 0, and 

x< A/2 and /z = A. 

According to the decision scheme, it is decided that the signal is present in cases 1 and 2; this is 
correct in case 1 and incorrect in case 2. The probability of case 1 is designated as p 9 and the 
probability of case 2 as a; p is the probability of correctly accepting x as the signal, and a is the 
probability of incorrectly accepting x as the signal. It can be shown that, if the probability of case 
1 is p and the probability of case 2 is a, then the probability of case 3 is 1 - a, and the probability 
of case 4 is 1 ~ fi. This simple hypothesis example can be described by using Table 1; the average 
probability of correct detection is 


P c = h/3 + h(l - a) . 


(la) 


Table 1 


The Meaning of a and p in the Binary Case. 


Decision 

Parameter 

M = 0 

fjL — A 

x <A/2 
accept H 0 , 
the hypothesis that 
no signal is present 

1-a 

probability of correctly 
deciding that no 
signal is present 

1 - /S 

Probability (type II error) 

x > A/2 
accept H x , 
the hypothesis that 
signal is present 

Probability (type I error) 

- a 

Probability of 
correctly deciding that 
signal is present, 
power P c 
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Similarly the average probability of error is 

P e = h a + h( 1 - /3) , 

where h = P = A), h = P(/i = 0), andh + h = 1. 

The best test is the one that minimizes the average risk for all 6 e n. Unfortunately since this 
is not in general possible, one is usually satisfied in finding the best test for certain 8's (the ones 
of interest). Another problem with the expression given earlier for the expected cost is the as- 
signment of values to C. . In most of the cases, the problem can be simplified by setting C 3 = c, = 0 
and obtaining 

r(d; 0 O ) = C 2 a; r(d; 0,) = C 4 (1-/3) . (2) 


It appears that the risk can be minimized if a and 1 - /S, the two types of errors, are minimized. 

The common procedure is to maximize /3, the power, while a is kept below a certain value which is 
determined by C 2 , C 4 and the expected value oi/S. Thus the best test is the one with the highest /3 
for a given upperbound on a. 

Tests are usually designed for maximum power (given the same a max ), and the search for a test 
is usually the search for a critical region which has some correspondence to the decision space. A 
criterion for finding the critical region for testing a simple hypothesis (a single null hypothesis and 
single alternative) is the Neyman- Pearson Criterion; it is a likelihood ratio inequality: 


f ( X l- X 2 


f( x l, x 2 



> C for 


6 e n - co . 


If the expression for the expected loss can be minimized with respect to both a and p with the cost 
functions C 4 = C 2 , C l = C 3 = 0, then this minimization is the Ideal Observer Criterion. 

When the a priori probabilities of H 1 and H 0 are known (h and h = 1 -h respectively), this 
knowledge can be used to advantage by properly weighing a and l -p to minimize the average risk 
function, which is defined as 

B(d) - E[r(d; 6)] = hr (d; ) + hr (d; 6> 1 ) , (3) 


Equation 3 is possible because h is known and some kind of loss function is assigned to C 2 , C 4 de- 
pending on the specific problem. Minimization of this expression is called the Bayes Strategy; it 
yields a solution for the decision criterion 


P { x/0 l) /h\ _ C 2 

i — ■ ■ 1 — ) > r~ ’ where 8 e fi - a> . 

P(x/0 o ) W C 4 

This inequality defines the critical region; it should be noticed that this inequality is a weighted 
likelihood ratio. 
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N-ARY DETECTION: MAXIMUM LIKELIHOOD DECISION 
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An n-ary detection system is illustrated in Figure 1, where s t s n are the source symbols, 

and x j x n are the received symbols. The received symbols are random variables with a given 

probability density function depending on the detection scheme, the signal transmitted, and the 
channel noise distribution. A transition matrix (Figure 2a) is associated with the input symbols; 
each element of the transition matrix p represents the probability that s £ will be received as 


x . . Finally a decision process is defined 
whereby one or more x . is associated with a 




P + (n-l) q = 1 

P (sj) = P (s 2 ) = ~ P ( s n) 


Figure 1 — -An n-ary detection system with a representa- 
tion of the noisy channel illustrating the possible 
reception of a signal Sj as Xj and the associated condi- 
tional probabilities. 


given s.. 

The transition matrix is a function of the 
channel noise and detection system, and the 
decision is a function of the average cost of 
error. To formalize this discussion, a cost 
matrix can be constructed as illustrated in Fig- 
ure 2b, where C.. is the cost of deciding that Sj 
was transmitted, when in reality was trans- 
mitted. Thus the risk function, which is the 
average cost of making a decision d } when Sj 
is observed, is 

r ( d i) = 2Z Ci ' P (V x i) ' (4) 

i 

This equation was obtained under the decision 
criterion that s = s j was transmitted if x. was 
received. 




(a) TRANSITION MATRIX (b) COST MATRIX 

Figure 2 — The transition and cost matrices of the channel of Figure 1. 
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The best decision criterion for this system is the one that minimizes the average risk for each 
j ; but it becomes complex. Fortunately, for our application 


C. . = C 8. . , where 8 . . 

ij ij i) 


f 0 for i = j 
\l for i ^ j 


( 5 ) 


because the cost of an erroneous decision is the same, irrespective of the signal decided on. When 
C.. is given by Equation 5, this decision criterion is identified as the ideal observer decision 
scheme. In this case, the average risk becomes 


E(r) 


£ P ( x i) r ( d i) 


2>i) E p Mi> 


Now 


= 1 ; 
i 

thus 

E(r) = 2H P ( X i) [ 1 " P ( S l/‘l)] ' (6> 

j 


and E(r) = i - P (correct detection). The left-hand side of Equation 6 is identified as the probability 
of error; thus, the ideal observer decision scheme minimizes the probability of error or maximizes 
the probability of correct detection; in other words, the ideal observer decision scheme, for each 
output x . , chooses an input s that maximizes the inverse probability p(s/x j ) because 

p ( x >) = J^ p ( s i) F ( x i/ s i) 


is a function of the a priori and transition probabilities only, and thus is independent of the decision 
scheme. 

Using Bayes* rule for any given x gives 


P( s i/x) 


P( Si )P(x/ Si ) 

P(x) 


If one does not know much about the source (a priori) distribution, then one can assume p( s . ) = l/n . 
For the foregoing case, maximizing the inverse probability is equivalent to maximizing P(x/s i ) . 
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Thus, for uniform a priori distributions, the ideal observer decision criterion selects the input s. 
which maximizes the likelihood function p(x/s i ) ; this is called the maximum likelihood decision 
scheme and is implemented by choosing the largest of the outputs as the signal transmitted. (The 
detector design depends on the probability density functions of the signals and of the channel noise 
and results in correlation detectors for gaussian noise and signals of known phase (Reference 10).) 


TESTS FOR OUTLIERS 

A class of tests applicable to the problems of n-ary detection (one out of n signals is the trans- 
mitted signal) is that of outliers (Reference 5). An outlier is an atypical point among a collection 
of points with the same characteristics. Although the outlier tests have been developed for the 
purpose of rejecting contaminators (i.e., sample points that come from another distribution), they 
can be used here to make a maximum likelihood decision (greatest of) in favor of the outlier whose 
distribution is N( / u 1 , a 2 ) in contrast with the remaining n - 1 sample points which come from the dis- 
tribution N(^ 0 , cr 2 ) . The development of the different tests for outliers is based on order statistics. 
Depending on the application and the specific interest, the values of the remaining n - l samples 
(correlator outputs) could be utilized for more information if needed. In general, if none of the 
samples are destroyed in the process of detection, order statistics are the most powerful. How- 
ever, for simplicity, only three or four out of n statistics could be used to extract most of the in- 
formation. In this case, the power decreases, but it may still be high enough. 

Tests for outliers may vary depending on the way that one regards the atypical point. Generally, 
the outlier is considered to come from a different distribution, and most of the time it is regarded 
as contamination. Consequently, the tests for outliers have been designed to decide whether a 
point(s) belongs to the same distribution as the rest of the data (with a given significance level) or 
whether it comes from a different sample space. 

While tests for outliers are normally designed to search for a possible contaminator, in de- 
tection theory one knows that the outlier (signal) is present and must decide which point is the 
contaminator. The foregoing knowledge should be appropriately used either to find the proper 
outlier test or to extend the outlier theory for this specific application. Also, exactly n - l samples 
are drawn from the same distribution, and only one sample is drawn from another distribution. 

This information could be used similarly in parametric or nonparametric hypothesis testing for 
distribution or some other equivalent hypotheses. 


SOME NEW STATISTICAL. TESTS 

Maximum likelihood decision is not the optimum scheme for all applications. By the use of the 
risk function, the introduction of certain statistical tests allow P e and P c to be controlled for opti- 
mum operation, based on the cost functions. The risk function also illustrates a method of com- 
paring the performance of tests without the knowledge of the cost functions. On the basis of these 
results, it can be shown that for the applications where the maximum likelihood decision scheme 
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is optimum, it can be further improved by using the aforementioned ratios for the determination of 
P e . This will provide each maximum likelihood decision with a confidence level. 

If the signal is not known or if the signal-to-noise ratio is very small, it is believed that out- 
lier theory, with some modifications, can be successfully applied for establishing confidence levels. 
Obviously, in the extreme case where one does not know whether or not the signal is being re- 
ceived, outlier theory is applicable with no need for approximations. 

A sample of points is usually represented by (x,, x 2> x n ) , the subscripts signifying 

ordering in time or space. An ordered sample is represented by (x (1)) x (2) , x (n) ). 111 this case 

the subscripts signify the order of the magnitude in reference to the rest of the sample. For ex- 
ample, x (i) is the point with the ith highest value. 

Maximum Likelihood Decision Scheme from the Hypothesis Testing Point of View 

A measure for comparison of tests in simple hypothesis testing is the power f3 for a given a max . 
For n-ary detection where the useful signal has the distribution f s (x s ) and the remaining n - l 
noise signals have the distribution f x (x), we want to test the hypothesis that the largest signal x (n) 
is not the useful signal x s (the useful signal is defined as the output of the correlator that corres- 
ponds to the transmitted signal; the noise signals are the outputs of any of the remaining n - l cor- 
relator outputs). To simplify the hypothesis testing, let us confine the number of competing signals 
to two, i.e., the useful signal x s and the largest of the noise signals x L ; thus, 

{ x. . has the distribution f L (x L ) , 1 

i.e., x (n) is the largest of the noise > 
signals; J 


and 


H : 1 9 e co 

1 n 


{ x has the distribution f s (x s ) , i.e., 
■>c (n) is the useful signal. 


If x (n) falls in the critical region X c , then hypothesis H 0 is rejected, and Hj is accepted; X c is part 
of the x space, the collection of all possible values that x (n) can take. Thus if x (n) can take all 
values from -co to % x = {-<», <»}, let X c = {b t , <»}, where b t is some value on the x-axis. The 
foregoing decision scheme states that if x (n) >B T , then we reject H 0 and decide that x (n) is the useful 
signal and that if x n < b t , we accept H 0 . Unfortunately, although we decided that the largest signal 
X(n) is a noise signal, we cannot find which is the useful signal because this is a composite hypothesis. 
If this were a simple hypothesis with a simple alternative (h 0 and Hj each involve one signal), then 
in accepting H 0 one could point out the signal. Thus in the case of n-ary detection, if x (n) > B T , we 
decide that x (n) = x s ; if x (n) < b t , then all we can say is that x (n) is not the useful signal; we shall 
call this action an indecision. 

In view of the foregoing difficulty we shall redefine the probability of correct decision to be 


P c = h/8 


(7) 
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(instead of P c - h/3 +h(l - a) as given by Equation la) and the probability of incorrect decision 
(error) as 

P “ha 

e 

(instead of P e = h a + h( l - /3) as given by Equation lb) where 


“ = P ( X („) 6 x c/ 0 n e “) - 

P = P (*(n)^ c /® n Cn -«) 

h = P(0 n eSl-w) , 


h - P(0 n ea). (1 

The remaining two terms of the binary P c and P e are h(l - a) and h(l ~/3) , These two terms are 
combined to give the probability of no decision, 

?nd ~ h( 1 - a) + h( 1 - yS) - h + h- ha-hyS 


= 1 - P - P . 

e c 


Substituting Equations 9, 10, 11 and 12 into Equations 7 and 8 gives 


P = p(x, x e X , e en-a>\ 

c V (n) c’ n } 


P e = P ( X („) eX c- ■ (15) 

Since 0 n eQ-aj implies x s > x L and since 0 n ew implies x L > x s , Equations 14 and 15 may be rewritten 


P e P ( X (n) 6 ’ X L > X s ) 


P c = P ( X (n) eX c- 


X s >X L 
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The maximum likelihood decision scheme can be derived from the foregoing scheme by setting 
X c = x. This sets the critical region equal to the whole outcome-space, which implies that B T = 
and x (n) always falls in the critical region. Consequently H 0 is always rejected, and the largest 
signal is the useful signal irrespective of the value of x (n) . Thus, 

P e = P(V) eX c’ 0 n £ “) = P (*„ e “) 

because X c = X implies that P(x (n) eX c ) =1 and similarly 

P c = P ( X („) £X c> e n en -") = • 

Since o> andfi-w are disjoint sets, P(d n efi-<u) = l -P(0 n ew) ; this implies that for maximum like- 
lihood decision P c = l - P e . P c was found to be (Appendix B) 


P c = J f s ( X s) 

•f —00 

The foregoing analysis indicates that P c is a function of P e and that the probability of error is only 
dependent on the parameters of the signal and noise. Furthermore, the probability of correct de- 
tection becomes maximum, but no control can be exerted on the probability of error. This draw- 
back of the maximum likelihood decision could be eliminated by returning to the more general prob- 
lem of hypothesis -testing with a more restricted critical region. 

A Decision Strategy Based on Thresholds 

Let B stand for some ratio n/v where N is a function of the difference between X(n) and some 
function of the sample such as the mean or the next to the largest sample point, and V is some func- 
tion of the spread of the sample such as range, standard deviation, or variance. The new critical 
region could then be formed by adding the condition thatB >b t in order for H 0 to be rejected. Thus 
the critical region is now restricted to the interval (b t , <» ) . 

The hypotheses for n-ary detection become: 


£ 


f x (x)dx 


dx 


H 0 : & n e a> where a> is the noise parameter space; 

Hj : 0 n e fi- co where n -a> is the signal parameter space. 


The critical region is the interval (b t , oo ) ; thus x (n) e X c can be replaced by B T <B L <o° in Equa- 
tion 16 and by B T <B s <oo in Equation 17. The resultant equations are 


and 


P e = P ( B L >B T. *L >X s) 
p c = P ( B S >B T- X L <X s) • 


(18) 

(19) 
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The new criterion could be used to lower P e to any predetermined value; but at the same 
time it lowers P and increases the probability of no decision (accepting H 0 ) which is given by 

c 

P ND = ! - p - p This is a more general scheme than the maximum likelihood decision scheme 
(MLDS) because one can reduce it to an MLDS by assigning an appropriate value to B T (such as 
b t = -a>). Thus by having control of P e , we can adjust it, depending on the loss functions to get the 
best strategy. This implies that one can control the error rate at the expense of a lower correct 
detection rate and a higher indecision rate. By introducing cost values for error, for correct de- 
cision and for indecision, one can solve for the appropriate B T that minimizes the average risk of 
Equation 3, which becomes 

13 = - Cj h/3 + C 2 ha + C 3 h(l-a) + C 4 h(l- / S) 

= " C ! P c + C 2 P e + C 3 (l-P.) + C 4 (1- P C ) " C 3 h “ C 4 h . (20) 

Finally, monitoring B will give an indication of the strength of the transmitted signal, thus 
placing a confidence level on the decision which can be used as an indication of decreasing signal 
strength. 

The threshold ratios of interest are (see Appendix C): 


X (n)'^ 


V)-* 


X ( n ) X 


n - X (") X ( n -D 

“4 <y 

_ X (n) ~ X (n- 1) 

B S ~ S 

and 

_ X ( n ) ~ x ("-i) 

6 ' X (n)“ X (l) 

Some of these ratios can only be used under certain conditions. For example, B t needs the know- 
ledge of ix and c r, and B 2 and B 4 need the knowledge of a. 

It should be noticed that the six ratios could be classified into two groups, one with the numer- 
ator equal to the difference between the largest order statistic and some measure of the mean, and 
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the other having as the numerator the difference between the largest and the next to the largest 
order statistics. As will be proven later, the latter group is more powerful than the former because 
of the fact that for our application the means of the statistics depend heavily on the mean of the 
noise, which is assumed to be constant. Consequently, the information contained in either the mean 
or the sample mean is almost zero. On the contrary, the information contained in the next to the 
largest order statistic is very high when only one of the signals (the useful one) has a different 
distribution. 

Of the first three ratios, Bj is the ratio with the most information if ^ and a- are known. If /x 
and a are not known, then it is weak, relative to b 2 and b 3 . b 2 is the next best because it assumes 
that cr is known. This ratio is more realistic in a practical situation because a can be approximated 
by s v , where s v has been computed by independent (previous) samples, with v very large (ideally 
infinite). B 3 is the studentized form and is the most powerful of the three if /x and o- are not known 
because it makes no assumptions about ;x and cr. Thus if /x and a are known, B t , b 2 , and b 3 is the 
order in which the ratios should be chosen; B 3 , B 2 , Bj if ^ and cr are not known, and B 2 is the best 
if only cr is known. In practical applications, /x and a are not known, and B 3 is the most powerful. 

Whatever holds for the relative performance of B 2 and B 3 holds for B 4 and B s since their de- 
nominators undergo the same change (cr to s). However, there is a basic difference between B fi and 
the former in that B fi is a function of only three samples. One would thus expect the information 
conveyed by B 6 to be much lower than that of B 4 or B ? . This is not true because the denominator of 
B 6 is the range which is very closely related to the variance, and also because finding x (1) requires 
knowing the values of the remaining statistics. Thus B 6 is expected to be almost as powerful as B 4 
or B s . 

Comparative Performance of Maximum Likelihood Decision 
Scheme and a Threshold- Type Decision Scheme 

The probability of error of a maximum likelihood detector is given by Equation B1 and depends 
solely on the signal-to-noise ratio; on the other hand, the probability of error in the threshold de- 
tector is decreased to a lower value by the extra condition thatB >B T ; to illustrate this by means 
of an example, if a total of M decisions are made in a MLDS, then the number of correct decisions 
is P c M, and the number of incorrect decisions is P e M. To lower the number of erroneous decisions, 
let us specify that the decision that x s = x (n) will be made only if B> B T . This scheme will reduce 
the number of incorrect decisions to some value P e M . This does not mean that the remaining 
(P e -P e )m decisions will be correct. It merely means that the remaining (P e -P e Jm cases will be in- 
decisions; i.e., we do not have strong enough evidence to reject H 0 . 

For the same reason, this strategy will lower the number of correct decisions ( P c M ) to a new 
number ^P c and will generate (p c - P c Jm indecisions. Summarizing, the threshold B T produced 
a gain by changing (p p - P e of the errors to indecisions, and a loss by changing (p c -P c Jm of the 
correct decisions to indecisions. The total number of indecisions is thus 
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Letting c 3 = C 4 = C ND in Equation 20 gives 

8 = - C,P c + C ND (l-P c -P e ) + C 2 P e , (21) 

and the change in the average risk in the foregoing example is 

AB = C 2 (P e -P ei ) + C ND (l-P.^Pj - C I (P c -P Ci ) • 

By assigning values to the loss functions C l9 C ND (the cost of indecision), and C 2 , one can optimize 
the gain by choosing the proper threshold B T , which in turn determines P e (b t ) and the correspond- 
ing P c (b t ). In the binary case, this is known as the binary erasure channel where error detection 
and correction could be used to improve the system performance. To illustrate this, consider the 
average risk with C ND = 0. Thus 13 = - C 1 P c +C 2 P e . Differentiating 13 with respect to P e and setting 
it equal to zero, reveals that the minimum risk occurs at the point where 



Now refer to Figure 3 which is a plot of P c vs. P e for a typical threshold decision scheme. The 
points along the plot signify the values of B T to which the point (p e , P c ) corresponds. As expected, 

the plot ends at the P c = 1 - P e line, which is the 
locus of the maximum likelihood decision points 
(for additional cases, refer to Appendix E). 

Let us now optimize 13 for three pairs of 
cost functions: 

1. Cj » C 2 ; this is the case where one is 
mainly interested in maximizing P c with no 
concern about P e . This is equivalent to mini- 
mizing \-/3 (the type n error) or saying that 
the type II error is much more costly than the 
type I error. Under this condition, the optimum 
point is the one with a slope close to zero. 

Since the point with the lowest slope is the 
maximum likelihood decision point M the system 
becomes optimum at this point. 

2. Cj = C 2 ; in this case, the decrease in 
P c is as costly as the increase in P e . In the 
binary case, this condition assigns equal loss 
to both types of error (a and 1 -/3). 

3. Cj <C 2 ; in this case, one places more 
value on the loss due to P e than the gain due to 
P c , and is consequently willing to sacrifice 

Figure 3— P c vs.P e for a typical threshold decision scheme. detectability for lower error rates. 
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The foregoing example shows that the maximum likelihood decision scheme cannot be compared 
in general to a threshold decision scheme unless the loss functions are known. A much more im- 
portant point is the ability to control the error with a minimum cost. Another application of the 
added restriction on the critical region is to use B for determining P e . This technique conserves 
the desirable properties of maximum likelihood decision but adds a feature that maximum likelihood 
alone does not possess. This feature is the ability to know with a certain confidence whether signals 
are being received and possibly if the signal and noise distributions have changed. This last property 
can be used to advantage in the case of an adaptive system. 


Relative Performance of the Threshold Ratios 

The performances of two ratios may be compared without the knowledge of the cost functions, 
by comparing the P c T s for the same P e . If 13 2 and B 2 are the risks of test no. 1 and test no. 2 re- 
spectively, then 

B 1 = C e P e + C ND (l-P e -P Ci ) + C c P C[ , 

6 2 = C e P e + C ND (l- P e ' P c 2 ) + C e P Cj , 

and 

= (C ND -C e )(p 2 -P c J ; 

C ND -C c is positive because the cost of no decision is larger than the cost of correct detection. Thus 


- 


= c 




if P c of test no. 2 is larger than P c of test no. 1, then ® 2 is smaller than 8 , , or test no. 2 is better 
than test no. 1 for the value of P e for which P c was calculated. This equation shows that P c is a 
measure of the goodness of the test when P c of each test is calculated for the same P e . The pro- 
cedure of finding P c for all P e ’s in the case of is as follows. 


P 

e 

P 

c 


1. Find g(B L ) , the pdf of B x under H 0 and x L 

2. Find g(B s ) , the pdf of under H 1 and x L 

3. Find p and P from 

e c 



is the cross-hatched area in Figure 4, while 
is the shaded area. 



Figure 4— P c ond P e as functions of threshold B T . 
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Applications to N-ary Detection 

It was mentioned previously that the maximum likelihood decision scheme could not be com- 
pared to the testing by ratios because in maximum likelihood decision, the critical region is the 
whole X space. This choice of critical region results in the single decision space; i.e., that x (n) is 
the useful signal. It was also shown that the MLDS is superior for some classes of applications, 
the main disadvantage being the complete disregard for the probability of error P e . This disad- 
vantage could be eliminated if one is willing to exploit information which is contained in the sample 
but which is not used by the MLDS. Given a sample of n outputs, the only information extracted by 
the MLDS is the maximum of x, , • • •• x . If in addition to this information, one utilizes some other 
information about the sample such as the value of the maximum (x L * • • x n ), the sample mean x, 
the value of the next highest statistic, etc., one could be in a position to attach a confidence level to 
each maximum likelihood decision. Any of the statistics mentioned in the paragraph on decision 
strategy based on thresholds can be used to make a maximum likelihood decision and to determine 
P e so that a confidence level (l - P e ) can be attached to each decision. Although the power of the 
different ratios differs, the confidence level does not depend on the power of the test, or on the 
probability of correct detection. Thus by adding the ratio test to the MLDS, in addition to the max- 
imization of the probability of correct detection offered by the MLDS, one is given the opportunity 
to monitor the probability of error, a feature not provided by the MLDS. 

The confidence level is a function of P which in turn is a function of the noise distribution, the 
signal distribution, and the value of the statistic B . In outlier theory, the distribution of the con- 
taminator (signal) is not known. Consequently P e depends only on the noise distribution and the , 

statistic B. This type of testing could be applied if we do not know whether the signal is being trans- , 
mitted and if we do not know f s (x s ) . However, if we know anything at all about f s (x s ) or the fact 
that the signal is being transmitted, then this extra information could be used to modify the outlier 
testing to make it more powerful. Consequently the difference in decision between outliers and our 
application is that we shall always accept x (n) as the contaminator or signal, but we will calculate 
P e each time, i.e., we will calculate the probability that x (n) could be a noise signal; then l -P e is 
the confidence that we can place on our decision. j 

DISTRIBUTIONS 

I 

The distributions of the ratios are closely related to P c and P e . Thus the knowledge of P c and 
P e completely specifies the distribution of the ratios. The three equations of interest are 



p e K f. (*.)• f, <*)] = P(B l >B t , X l >X s ) , 

(22) 


P c [ B s’ f s (*s)> f x <*>] = P (B S >B T , X s >X L ) , 

(23) 

and 

a o[ B L. f x (*)] = P (B L >B T ) . 

(24) 
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The first two are exact parameters and depend on the distribution of the useful signal. The third 
equation is only a function of the noise and does not depend on the signal. This is the type of equa- 
tion that is used in outlier theory and is very useful for small signals or when one does not know 
whether or not the signal is present; this equation can also be used to make inferences regarding 
the signal. These equations are the basic equations that will be used for determining the average 
probability of error P e and the average probability of correct detection P c for both the exact and 
other cases. The threshold ratios given earlier will be compared by finding the P c 's for a given 
Pe- 


lt was previously mentioned that the confidence level of a maximum likelihood decision could 
be found by solving for the distribution of the confidence ratios. Each confidence ratio has two 
probability distribution functions, one under the correct decision and one under the incorrect de- 
cision. The former is called g(b s ) and the latter g(b l );g(b l ) = 1 -P e , and g(b s ) = 1 -P c . The 
ratios of interest are, in general, functions of x (n) , the largest order statistic; x (n . 1} , the next to the 
largest; x (1) , the lowest; x, the sample mean; s, the sample variance; and, of course, ^ and a if 
they are known. This implies that to solve for g(b l ) and g(b ) one must know the distribution and 
parameters of the useful signal and the noise signals. For these distributions called f s (x s ) and 
f x (s) , respectively, the null hypothesis is: the largest order statistic comes from the noise dis- 
tribution f x (x) . The null hypothesis is slightly more complicated by the fact that the useful signal 
x s is smaller than the largest of the n - 1 noise signals x L . Thus in calculating P e , one could find 
the probability that x L will be larger than c t (a constant), ignoring the fact that there is a useful 
signal present which is less than x L , one could take into consideration the fact that x s is smaller 
than x L . The former approach is the outlier approach, while the latter results in the exact value 
of P e and in general depends on the distribution and parameters of x s . 

Hypotheses Employed in the Two Approaches 
The exact approach employs the hypotheses 

H 0 : 0 n e co: the parameter space of the n - 1 noise signals x and 
H t : 0 n e n- 01 : the parameter space of the useful signal x s . 

Thus H 0 is the hypothesis that x (n) came from the distribution of the n - 1 noise signals and that the 
useful signal is in the sample but is not the largest signal x (n) . For this hypothesis, P e and P c 
become P e = p(b>b t , x L >x s ) and P c = p(b>B t , x L <x s ). 

In the outlier approach, the hypothesis is x (n) came from the noise distribution of n noise sig- 
nals with no reference to any useful signal. This is a good approach if one does not know if x s is 
being transmitted or if the signal-to-noise ratio is very small; the hypotheses are 

H 0 ; 0 n e w the parameter space of the n noisy signals and 

Hj ; d n e n- a; another parameter space, not the one of the n signals. 

In this case, a 0 is the probability that the nth noise signal is such that B > B t and consequently the 
probability of incorrectly deciding that the nth largest noise signal did not come from the distribution 
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of the remaining n - 1 signals; thus, P e = p[b >b t for a given f x (x (n) )J. There is a fine point here, 
i.e., we started with a null hypothesis that all n signals are noisy, and, if B >B T , we decide that only 
n - 1 signals are noisy and the nth largest is from another distribution. Obviously no use was made 
of the fact that x s is one of those signals and that we cannot distinguish it because it is not the 
largest. As a result of this omission, the power of this outlier test is expected to be lower for the 
same a (i.e., a is expected to be higher for the same /3). 

The outlier approach gives a simple decision scheme which is independent of the distribution 
of the useful signal. Unfortunately, this method results in a loss of power because of the complete 
omission of x s . A test having the desirable properties of the outlier tests, such as ignoring the 
distribution of x s , but which does not ignore the presence of x s is the described outlier test with n 
replaced by n - 1 . The hypotheses of this modified outlier test are 

H 0 ; 0 n e oi the parameter space of the n - 1 noise signals and 

Hj : 6 n e fi- co another parameter space not the one of the n - 1 noise signals 
and P e is given by a = p(b > b t | x l = x (n) ) . 

The size and power can be expressed in terms of the distributions of B under correct and in- 
correct detection as 


p[b>b t |g(b l )] , 

(25) 

p[b>b t |g(b s )] , 

(26) 

P(B>B T |n noise signals) , 

(27) 

P(B>B T |n-l noise signals) . 

(28) 


Clearly Equation 28 acknowledges the presence of the useful signal x s but does not utilize its dis- 
tribution in solving for a; thus it is more powerful if it is known that the signal is present, and 
Equation 27 is preferred if no such knowledge exists. 

Generalized Distributions of B 

Although B could be any function of (x, , • • *, x n ) , the ratios of interest will be functions of /i, 
o-, s,x, x (1) , x (n _ 1} , x (n) (x (i) is the ith order statistic; X(1) is the smallest; x (n) is the largest; and 
x (n _ X) is the next to the largest). 

In general, B = Q(x t , • • • , x n ); if we apply a transformation such that 
x i = T i (vi* y 2 - ••• - y n -r B ) i = i, ••• , n 


18 


with a Jacobian J , then the pdf of B, g(B) becomes 


g(B) 


<*00 <*oo 

= Q [ x d) = T i (yi- y n -i- b ) x ( 2 > 3 T 2 -- ,,x ( n) = T n]lJl d yi ••• d y n -i 

J-CO j -CO, 


R n _ ^ dim space 


To find g(B s ) , let x (n) x s , f(x (n) ) - f s (x s ). Then 


g( B ) 


r x s =T i p r 

J -CO J -oo J — c 


Q .0 


■(i) 


= T, 


Vn-l) 


- Vn-Jljl <bi **; dy n _ x . 


It should be noticed in the foregoing equation that, in order to incorporate the condition that 
x s > x L = x (n _ 1} , it was necessary during the transformation to preserve x^.jj . Then the proba- 
bility of correct detection P c (b t ) becomes 


P c ( B t) = P c 



The procedure of finding f (b l ) is slightly more complicated because b l is the ratio with x (n) = x L , 
where x L is the largest noise signal; but the condition x L >x s implies the union of the disjoint events 


*L- 1 > X L ~1 


*L- 2 9 


, x ( 1 ) >x s * Thus letting g. (b l ) be the case x (i „ X) <x s <x (i) , 


f 00 r x i =T i r 00 

i ( b l) = • •• Qj ( x (i) = Tj, •••x s = Y s , x, = Tj • • • x (n _,j = T n _ 1 )|j|dy 1 ' ‘ ' dy n _ 1 

» -00 Jt J -00 


and the probability of error becomes 


n-l /-oo 

P e = £ J MMdPL • 


When B is a function of all the order statistics as in the case where x and s are involved, 


n 

= 1 *. 


and 


s 


1 

n~l 


£ V *) 2 ■ 

; =1 
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The expressions for P e and P c are as complex as they look; this is the case of B 2 , b 3 , and B s . When 
B is a function of one, two, or three order statistics such as in the case of B lf B 4 , and b 6 , then the 
expressions for P e and P c become relatively simpler with only three to five integrations. For the 
outlier case, f(B L ) is obtained by replacing x (n) by x L and ignoring x s , by assuming that all other 
signals came from f x (x). For the modified outlier case, g(b l ) is obtained by letting n equal to 
k, the number of noise signals, and replacing x (n) by x L . 

The Distribution of Indecision 

When the threshold decision is used, the sum of the probability of error and probability of cor- 
rect decision is not in general equal to unity. Since P e +P c represents the probability of decision, 
the probability of indecision is given by 

P ND = 1 - ( P e +P c) • 

Although P ND can be solved from the foregoing equation, once P e and P c are known, it will be shown 
in this section that P decision where P decision = P e + P c can be found in a more direct way without the 
knowledge of P e or P c . This objective will be reached by the application of a theorem on the proba- 
bility of the realization of at least one among n equiprobable events k i . 

From set theory, it can be shown (Reference 11) that the probability of the union of n events 
is 



£/. -£I> nA .> n A . n # ‘> - 


if P(A. ) is the same for all i, and P(A. n A.) is the same for all i, j, and so on; then 



or 


n P(Aj ) - OK n a.) + (3) P ( Ai n A j n A k ) 


(~i) n p(Aj n a 2 • • • A n ) 


p 





( 29 ) 


where P. designates the i-fold joint probability density function of the i out of n events. Equa- 
tion 29 applies in the case where the density function of all statistics are the same. 
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If the pdf's are not all the same, the form is slightly different; for example, in the case where 
n - 1 statistics have the same pdf, and one statistic has a different pdf, Equation 29 becomes 


P 



a signal 
is 

present 


^(-D-trDkn-DP, +P M>t ] 


(30) 


where P._j s is the i-fold joint of the different pdf statistic with i - 1 out of n - 1 remaining statis- 
tics. For independent events, P. = [p(A. )J ‘ . Letting A s be the event that x s > B T , and A. the event 
that any of the n - 1 remaining signals is greater thanB T , Equation 30 will give the probability that 
any of the n - 1 noise signals and the useful signal will be greater than B T . Thus for 


A s - the event {x s >B T }, P(A g ) 



A. - the event {x>B T }, P(A. ) 



(x) dx for 


2, 3, • ** n . 


Equation 30 gives the probability of decision P e +P c under the exact hypothesis that f s (x s ) is known. 
If f s (x s ) is not known, the probability of decision is given by Equation 29 with n = k; k takes the 
values determined by the discussion in Equation 24. 


The usefulness of Equations 29 and 30 can be extended to finding P e or P c if one of them is 
known. In certain cases, an approximate evaluation is possible with only one to three of the first 
terms of the series, but in others (especially for large n) the binomial coefficients become excessively 
large, thus introducing relatively large errors even when double-precision computation is used. 


Summary 

Three different procedures for setting a confidence level were outlined in this section. The 
first one was the exact method, which requires knowledge of the distribution of both the noise and 
the useful signals. In this case, P e and P c are given by Equations 22 and 23. The outlier case described 
the outlier technique, where the presence of the useful signal is completely disregarded. Since P c 
depends on f g (x s ) , one cannot find an expression for P c unless one is willing to specify f s (xj , 
an action that defeats the objectives of outlier theory (P c can still be found experimentally for test- 
ing purposes or analytically for reason of comparison). In this case, a Q is given by 


a 0 = p{B>B T |f[x L (k)]}- 


where f(x) signifies the pdf of the n noise signals. The modified outlier case is a compromise 
which makes use of the fact that x s is present by simply using the correct number of noise signals, 
i.e., n = k. This method still conforms with the outlier philosophy by disregarding the pdf of x s . 
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In this case, a is given by 


a = p{B>B T |f[x L (k-l)]} . 

THEORETICAL RESULTS 

Obviously the aforementioned ratios belong to two distinct groups depending on the numerator 
function. The first group is the one where the numerator is the extreme deviate, x (n) - q(x), and 
the second has a numerator of the form X(n) -x ^ ; obviously as n ->®, s -a, and the second 
and third statistics converge to the first statistic. There exists a similar relationship between B 4 
311(1 B s* B 6 belon g s to the same class as B s since the range is a measure of the standard deviation. 
The cdf of these ratios can only be obtained by numerical methods. B 2 , B 3 , and B $ become even 
more complex with n-fold integrations because of the dependence of x and/or s on x (n) . 

Since we are interested in values of n ranging from 16 to 128, this could mean as many as 
128-fold integrals for numerical integration. This prohibitive complexity and the fact that B 2 and 
B 3 converge in probability to B, as n-® and B s converges in probability to B 4 as n - % are considered 
to be sufficient justification to limit our investigation to B t , B 4 , and B g . Thus by application of the 
equations given in the section on distributions we have derived (see Appendix C) the distributions 
for Bj , B 4 , and B 6 in terms of the unspecified probability density functions. 

When the channel noise is normally distributed, it can be shown (Reference 10) that the 
correlator outputs are normally distributed in the case of coherent detection; for the case of non- 
coherent detection, the pdf's are Rician. In this section, normal and Rician pdf's are substituted 
for the unspecified pdf's in order to derive the probability of error P e and the probability of correct 
detection P c as a function of the value of the threshold ratio B T . 

The Extreme Deviate B . 

For the coherent case, substituting f x (x) = Ce - * 2 / 2 and f ( x ) = Co'< x ~ A > 2 / 2 for -®< x <®in 
Equations C7 and C8 gives 
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where C = The outlier confidence level is from Equation D4: 


l 



( 33 ) 


where k is the number of noise signals. 

For the noncoherent case, substituting f x (r) = re "'^ 2 and f s (r) = r e'( , 2 +A ^ 2 l 0 (rA) for 
0 < r <00 in Equations C7 and C8 gives 


•'B- 


and 


P 




xe -(* 2+A2 )/2 


I 0 (xA) dx . 


In this case the outlier confidence level becomes 


l 




(34) 


(35) 


(36) 


In general, the confidence level is in the form 1 - a, and once a is known for some B T one can 
determine the confidence level by using Equations 32 or 35 if f s (x s ) is known, and Equations 33 
or 36 if f s (x s ) is not known; thus a = p(b >b t /x s <x l ) . Letting k = n - 1: a 0 = p(b >B t ). From 
these relationships, it is obvious that a 0 ia or i - a 0 < l - a. 

Thus, if f s (x s ) is known, P e can be found for the exact case; having found P e one can find the 
confidence level 1 - P e . If f j (x s ) is not known, the outlier approach must be used, resulting in an 
overestimated a 0 and a conservative confidence level. 

B u 

For the coherent case, substituting f s (x s ) and f x (x) in Equations Cll and C14 gives 


P 

c 


a CO /-CO 

(n-l)dB 
Jr J ~oo 


C 2 e -(x-A) 2 /2 


e -(x-B) 2 /2 



Ce 


2 /2 



dx 
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and 


| (n - 1) dB J" (n-2)C 2 e' x2/2 e'( x_B ) 2/2 ^J Ce"* 2 / 2 dt j dx J 


=-(y-A) 2 /2 


C 2 e -x 2 /2 e -(x-A-B) 2 /2 


Ce _t 72 dt 1 dx 


Similarly, substituting f (x) in Equation D6 gives the confidence level in the outlier case: 


- s ■ r 

•' -00 


k(k - 1) dB C 2 e* x2/2 e '( x ~ B > 2/2 ( Ce'‘ 2 / 2 


dt I dx 


For the noncoherent case, substituting f s (x) and f x (x) in Equations Cll and C14 gives 

P c = f (n - 1) dB f r 2 e -( r2 + A2 y2 I() ( r A)e _ < r ' B > 2/2 [l -e'< r-B > 2/2 ] n 2 dr 
•'B~ J n J 


J" l)dB jj\> , 0 (rA . M) 

+ f (n-2)r 2 e' r2/2 e( r - B ) 2 / 2 [l-e-( r - B > 2/2 ] n ’ 3 dr I" 

•'o Jo 


By using Equation D6, the confidence level in the noncoherent case is 


t e _ (‘ 2 + a 2 )/2 j (tA)dt 


r B T r 00 

- a 0 = k(k - 1) dB I r 2 e^ 2 / 2 e'< r ‘ B > 2/2 [l - e'( r ' B > 2/2 ] k 2 dr 

•'o Jo 


For the coherent case, substitution of f s (x) and f ( x ) in Equations C16, C20, and D8 yields 


(n - 1) (n - 2) dB Ce~( x ~ A > / 2 dx I Ce - * 2 / 2 dt ) c 2 e"< x ' w > 2/2 e'< x ' Bw ) 2 / 2 - 
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J » 1 r “ z*® / /• x-Bw 

(n- 1) (n - 2) dB Ce'^dx C 2 e ‘< x ' wB_A ) 2/2 e _ < x * w > 2 ' /2 w( 

B t j'-o> J() \Jx-w 


n-3 

Ce _t 72 dt j dw 


pco -co t -x“Bw \ n * /*x"wB 

+ (n - 3) I dx j (I Ce _t ^ 2 dt J C 3 e ~( x ” w ) e ~( x “ wB ) e” x ^ wdw I Ce“( y ~ A) ^ 2 dy 

•'-oo J 0 \«J X-W / -'-00 


and 


t b t r 00 /•“ / rx-B«. \ k * 3 

- a Q = 7 ^ ~ry yT dB dx I w( I Ce" t2/2 dt] C 3 e -[ x2+ < x -w) 2 +(x-Sw) 2 ]/: 

•'O ^ -oo J 0 x _ w / 


dw 


For the noncoherent case, substitution of f s (x) and f x (x) in Equations C16, C20, and D8 
results in 


= f (n- 1) (n - 2) dB f f r 3 e' [ r2+A2+ (^) 2+ ( r -» B ) 2 J/ 2 I 0 ( rA) f f te'^ 2 dt) 

Jb t Jo Jo \Jr-w * 


te’ 1 72 dt j w dw dr , 


-1 -oo-co / -r-wB \ n ~ 3 

= J (n-l)(n“2)dB I I r 3 e“ [ r + ( r “ wB ) +A + ( r " w ) ]/ 2 I Q ( rA - w BA) w( I te _t dt j dwdr 
J b t Jo Jo \Jr-w / 


n -4 ~ 

n oo / -r-wB \ -r-wB 

r 3 e“[ r + < r " w ) +(r' wB )]/2( j te~ t//2 dt j dwdr j ye“ ( y +A V 2 l Q (yA) dy 
0 \«/ r — w * Jo 


and 


1 


j T ( k^ 3)T dB| | r 3 e -[ x2+ (r-w) 2 t (r-wB) 2 ]/ 2 ^J te'^ 2 dt^j 


dw dr 


Discussion 

The majority of the equations derived so far are impossible to evaluate or reduce to closed 
form, especially if n > 16. For some limited values of n, A, and b t , the cdf’s can be expressed in 
terms of polynomial approximations (References 12 and 13), especially for combinations of n and 
A that result in the tails of the distributions. To obtain a complete picture of the dependence of P e 
and P c onn. A, and b t , the expressions for P e and P c were numerically integrated for all combina- 
tions of A = 1, 2, 3, 4, 5, 6, 8, 10 and n = 16, 32, 64, 128. The ratios of interest were B,, B 4 , and 

B, for both the coherent and noncoherent detection; some of the results are tabulated in Tables El 
6 
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through E6. These tables were in turn used to plot Figures El through E6. Each figure contains 
plots of the probability of correct decision P c vs. the probability of erroneous decision P for some 
interesting combinations of n and A. 

It should be noticed that the detectability is degraded as the number of signals is increased; 
this result was expected and becomes obvious if Figure 5 is observed, where the pdf of the highest 
of n noise signals is plotted. (From the information point of view, the detectability must deteriorate 
as n is increased because, by increasing n, we increase the information rate, thus operating either 

closer to channel capacity or exceeding channel 
capacity.) It should be noticed that for n = 127, 
the mean of x L (the highest noise signal) is 
roughly 2.5, and the standard deviation is 
roughly 0.5; this indicates that unless the use- 
ful signal has a mean greater than 2.5 the 
probability of error will be larger than the 
probability of correct detection on the average. 
This can be verified by looking up P e and P c 
for A = 2 and A = 3 with n = 128. It should 
also be noticed that as B T increases, both P e 
and P decrease and that the maximum P and 

c e 

P c occurs for B T zero or -® (depending on the 
function defined by b), and they lie on the 
straight line defined by P c = l - P e . This is the 
line that represents P e and P c for the maximum 
likelihood decision scheme which is obviously 
a special case of the more general decision 
scheme proposed in this paper. 

Some graphs representing Bj, B 4 , and B 6 were superimposed in Figure E7 in order to illustrate 
the relative performance of these ratios. It can be seen from this figure that B 4 performs as well 
or better than B [ and that B 6 performs as well as B,. The difference in performance is not large 
enough to justify the preference of one ratio over the other based on performance alone. The choice 
of the ratio should be based on the amount and type of knowledge about the signals so that all as- 
sumptions are satisfied. For example, B fi does not require any knowledge about i± and a of the sig- 
nals; B 4 requires knowledge of a, and b 4 requires knowledge of both /* and a. 

Applications 

The plots of Appendix E can be used in many ways depending on the type of problem. If one is 
only interested in maximum likelihood decision scheme, then by observing the value of B, one can 
attach a confidence level on the decision. For example, consider coherent detection using the max- 
imum likelihood decision scheme with A = 2, n = 32, B = B 4 . Suppose that we made a maximum 
likelihood decision and that x (n) = 5, = 4.6, and a = 1; then B 4 = (5-4.6)/l = 0.4. Thus by 

making use of the information contained in the value of x and x we can say that x is the 
_ , ( n > ( n_1 ) ( n ) 
useful signal with a confidence about 82.5 percent (p =0 2) 



— X 


Figure 5— The pdf of the largest of n normal ly distributed, 
independent, random variables with zero mean and unity 
variance. 
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If errors in excess of one in ten cannot be tolerated (this could be the case where an error 
correction code will break down, and it is preferable to retransmit if the error rate is larger than 
0.1), assuming A = 3, n = 32, and the ratio B = B g noncoherent, refer to Figure E6 and lookup B T 
for P e = 0.1; extrapolating, b t = 1.6; thus we can set a threshold and either accept x (n) as the use- 
ful signal if B > 1.6, or ask for retransmission if b a < 1.6 (of course we need the values of x 
X ( n - 1 ) > ^ x ( i) to calculate B 6 ). If the values of the cost functions c 2 , C 2 , C 3 , and C 4 are known, 
the decision system can be optimized by minimizing the average risk: 

8 = “ C,P c + c 2 p e + c 3 (l-P e ) + c 4 (i-p c ) - C 3 h - C 4 h 

= - P C ( C l +C 4 ) + P e( C 2- C 3 ) + C 3 S + c 4 h ■ 

Since 8 , P e , P c are functions of b t , differentiate this equation with respect to B T and set it equal to 
zero. The result is 


This result indicates that the optimum threshold B T for any b(b, , b 2 , • • • B 6 ) is the point on the 
appropriate curve which has a slope equal to (C 2 -C 3 ) / /(c i +C 4 ) . Since the curves are monotonic, 
the solution is unique. Since the maximum likelihood decision points lie on the p = i - p line, 
obviously they do not in general represent the point of optimum operation. For example, let 
C 3 = C 4 “ 0 and Cj = C 2 ; then (C 2 -C 3 )/(C X +C 4 ) =1, and the optimum b t is the one corresponding 
to unity slope, which for B t coherent occurs at the points indicated in Figure 3. It can be seen that 
for the cost functions mentioned, the maximum likelihood decision scheme is optimum for A > 4; 
however, for values of A < 3, the maximum likelihood decision scheme is not optimum (the optimum 
points are for A = 3, n = 32; B T % 2.0; for A = 3, n = 64; b t % 2.4; for A = 3, n = 128, B T % 2.8; 
for A = 2, n = 16: B T * 2.0; for A = 2, n = 32: B T * 2.6 and so on). The last result shows that 
only the relative magnitudes of c 2 , C 2 , C 3 , and C 4 are sufficient for the determination of the point 
of optimum operation. 


EXPERIMENTAL RESULTS 

As was mentioned earlier, the solutions of P e and P c for the ratios B 2 , b 3 , and B 5 become im- 
practical; it was shown, however, that for large n, the distributions of these ratios converge to 
those of the ratios discussed in the section on theoretical results (b 3 , B 4 , and b 6 ). Since the n's 
of interest (n = 16, 32, 64, 128) are fairly large, the performance of b 2 and B 3 is expected to be 
comparable to that of B t and the performance of B s comparable to that of B 4 . To substantiate this 
argument a simulation was conducted where normally distributed numbers were generated with 
mean zero and variance one; half of the histogram of 100,000 numbers from this distribution is 
shown on Table 2. It can be seen that it is very close to the theoretical histogram. 
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Table 2 


» 


The Histogram of the Random Numbers Which Were Generated for the Simulation. 


Interval 

Exper 

Theor 

Interval 

Exper 

Theor 

Interval 

Exper 

Theor 

Interval 

Exper 

Theor 

0-0.04 

1607 

1595 

1-1.04 

948 

949 

2-2.04 

207 

207 

3-3.04 

15 

17 

0.04-0.08 

1588 

1593 


909 

910 


187 

191 


15 

15 

0.08-0.12 

1590 

1587 


869 

871 


175 

177 


12 

13 

0.12-0.11 

1586 

1580 


825 

833 


159 

161 


12 

12 

0.11-0.2 

1568 

1571 

1.16-1.2 

797 

796 

2.16-2.2 

148 

149 

3.2-3.24 

9 

10 

0.20-0.24 

1562 

1557 


760 

758 


136 

135 


9 

9 

0.24-0.28 

1549 

1543 


716 

721 


122 

125 


9 

8 

0.28-0.32 

1525 

1525 


687 

686 


112 

113 


6 

7 

0.32-0.36 

1509 

1507 


650 

650 


103 

103 


6 

6 

0.36-0.4 

1489 

1484 

1.36-1.4 

625 

616 

2.36-2.4 

95 

94 

3.4-3.44 

6 

5 


1452 

1461 


578 

583 


87 

85 


3 

5 


1444 

1436 


549 

549 


76 

78 


6 

4 


1408 

1408 


519 

518 


69 

70 


3 

4 


1376 

1379 


489 

488 


63 

63 


3 

3 

0.56-6 

1349 

1349 

1.56-1.6 

457 

458 

2.56-2.6 

57 

57 

3.6-3.64 

3 

3 


1316 

1316 

! 

429 

430 


52 

52 


0 

3 


1276 

1284 


406 

402 


45 

46 


4 

2 


1252 

1248 


375 

376 


43 

42 


3 

2 


1215 

1214 


352 

352 


36 

37 


0 

2 

0.76-0.8 

1178 

1177 


330 

327 

2.76-2.8 

36 

34 

3.8-3.84 

0 

2 


1141 

1140 


307 

304 


27 

30 


3 

2 


1100 

1103 


282 

284 


27 

27 


0 

1 


1064 

1064 


265 

262 


25 

24 


0 

1 


1031 

1026 


244 

243 


21 

21 


0 

1 

0.96-1 

991 

987 

1.96-2 

221 

225 

2.96-3.0 

18 

19 

3.96-4.00 

3 

1 


A sample of n of these numbers was drawn, and the first one was given a bias A, (x s = x 3 + A), 
resulting in n - 1 numbers from n(0, 1) and one from N (A, 1). This experiment was repeated 1000 
times, and each time the ratios R,,R 2 , R 3 ,R 4 ,R S ,R 6 , x, s, etc. were calculated, and histograms 
were made, both for the case where x s = x (n) and when x s < x (n) (in the latter case the largest sig- 
nal is the largest noise signal x L ). The foregoing histograms were converted into cdf's. Thus the 
value of the resulting cdf was identified with l - P when X/ = x and l -P when x, = x, . Parts of 

c (n) s e 

the experimental results are tabulated in Tables E7 to E18, and the corresponding graphs were 
plotted in Figures E8 to E19 to show the deviation of b 2 , b 3 , and B $ from b 3 and b 4 . 
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* This experiment was also repeated by generating a Rician distribution. It should be noticed 
from the appropriate tables or plots that the agreement between the theoretical and experimental 
results for B 1? B 4 , and B g is excellent. A further look into the plots containing B 1} B 2 , B 3 on the 
same graph and B 4 , B s , B g on the same graph substantiates the argument that the performances of 
Bj, B 2 , and B 3 , are comparable and so are those of B 4 , b 5 , and B g . The foregoing results were ob- 
tained for all combinations of n = 16, 32, 64, 128, and A = 1, 2, 3, 4, 5, 6, 8, 10; however, since 
for A > 5 the probability of error approaches zero and the probability of correct detection approaches 
unity, graphical representation for the cases A > 5 became difficult; consequently the cases for 
which A > 5 were omitted. 


CONCLUSION 

The aims of this paper have been to introduce some functions of the observations at the correlator 
outputs which could be used to place confidence levels on our decisions, control the error rate or 
determine the optimum decision scheme with the aid of loss functions and to analyze the perform- 
ance of the aforementioned functions (ratios) in order to obtain numerical results for the first ob- 
jective, and to compare their relative performance. A generalized decision scheme was introduced. 
The decision space consisted of two points— d x : x is the useful signal, and d 2 : x (n) is not the use- 
ful signal. The decisions depended on the value of a function of the correlator outputs B. If B > B T , 
the decision was d l ; if B<B 5 , the decision was d 2 . The probability of error is P e for d x and 1 -P c 
for d . The probability of correct decision is P c for and l -P e for d 2 ; the probability of d t is 
P e + P c , and the probability of d 2 is l - P e - P c . Since the decision that x (n) is not the useful signal is 
an action that leads to no decision, d 2 is an indecision for our specific application, and l -P e -P c is 
the probability of indecision. Similarly, P e +P c is the probability of decision that X(n) is the useful 
signal; P e is the probability of erroneously selecting X(n) as the useful signal; and P c is the prob- 
ability of correctly selecting x (n) as the useful signal. If the loss function c l9 C 2 , C 3 , C 4 is known, 
the value of b t that results in the optimum decision scheme can be determined graphically from 
the P c vs. P e plots by choosing the point on the appropriate curve with slope (c 2 “C 3 ) / /(c i +C 4 ) . On 
the other hand, if one’s only concern is to keep the probability of erroneous decision P e below a 
certain value P e , then b t is the B that corresponds to this value of P e , P e . If b t is set equal to -oo, 
then the probability of d t becomes unity, and the probability of d 2 becomes zero. Thus 

P + P =1 and l - P - P = o . 

e c e c 

The probability of error in d 1 ,(P e )is equal to the probability of error in d 2 , (l -P c ) , if there was 
a d 2 (but P(d 2 ) = 0 with B T = -oo ), This value of b t results in a degenerate case of the generalized 
decision scheme that we started with, and it is identified as the maximum likelihood decision 
scheme because under the maximum likelihood decision scheme we always make decision d 1 ir- 
respective of the value of B (the critical region b t < B< oo contains all values of B when B T = -oo ). As 
can be observed from the graphs, this technique results in the maximum P c but also maximum P e , 
with the probability of indecision l -P e -P c equal to zero. Since, under the maximum likelihood 
decision scheme, we have no control on B T and consequently on the probability of error, the only 
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improvement that we can add to this technique is to calculate B for each decision and, by searching 
the graphs or tables for the corresponding value of P e , to determine the confidence level of each 
decision by calculating 1 - P e . This number could be used for determining the degree of the validity 
of decisions and or assumptions about the signal and noise parameters. Finally the results in- 
dicate that the performance of B 4 is as good or better than that of B 1} which was expected because 
it was assumed that the parameters n and a were known. If m is not known, then B 4 is superior. If 
nothing is known about jj. or a 2 of the noise, then B g should be used. This ratio is a function of only 
three statistics x (1) , x (n _ 1} , and x (n) ; it is relatively simple to calculate, and performed almost as 
well as B 4 , the ratio with the best performance. 

Finally the experimental results confirmed the theoretical results onB ( , B 4 , and B g and sub- 
stantiated the argument that for n - 16 , B 2 and B 3 perform as well as Bj, and B s performs as well 
as B„. The difference in power of the six ratios was so small that the preference of one ratio over 
another should not be based on performance alone but rather on the satisfaction of the assumptions 
associated with each ratio and the simplicity of calculating the ratio. 


Goddard Space Flight Center 
National Aeronautics and Space Administration 
Greenbelt, Maryland, May 4, 1967 
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Appendix A 

LIST OF SYMBOLS 

The significance level (also known as the type I error). 

Probability of error. 

The power (also known as the probability of rejecting H^Hj). 

The probability of correct detection. 

Means "an element of." 

Means "not an element of." 

Is used for the parameter space. 

Is used for the parameter space under H 0 . 

The null hypotheses; unless otherwise specified, H 0 is the hypothesis that the 
largest signal is noise. 

The alternative (hypothesis); unless otherwise specified, a l is the hypothesis that 
the largest signal is the useful signal. 

Means normal distribution with mean a and variance b 2 . 

The ith order statistic. 

The largest of the n - 1 noise signals. 

The value of the ratio that separates the acceptance from the critical region. 
Abbreviation for probability density function. 

Abbreviation for cumulative probability distribution function, 
pdf’s of the noise and useful signal respectively, 
cdf’s of the noise and useful signals respectively. 

The average signal energy per bit. 

The noise power density per unit bandwidth. 

The sample mean. 

The sample standard deviation. 

The number of words. 
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Appendix B 

PROBABILITY OF ERROR FOR THE MAXIMUM 
LIKELIHOOD DECISION SCHEME 


Let Xj, x 2 , x n _j from f(x) and x s from g(x). Let x 4 be the ith largest sample point from f( X ). 
The probability density function of x L , the largest sample point from f(x), is (Reference 14) 


h (x L ) dx - (n- 1) [F(x)] n_2 f(x)dx , 


(Bl) 


where 


since 


F(x) 



f(t)dt ; 


f (x) dx - dF(x) , 


Equation Bl can be written as 


h (x L )dx - h(x n . 1 ) dx - (n - 1) [F(x)J 1,-2 dF(x) = d[F(x)] nl . (B2) 

The probability of correct detection in maximum likelihood decision is equal to the probability 
that the largest of the noise signals x L is less than the useful signal x s . Thus 


3 j g( x s) f d[F( x )] n-1 dx s 
*'-00 -/-oo 


= L g ( x s)[ F M nldx * 


r 

r*s 

I g( X s) 

J -CO 

I f(x) dx 

J -CO 


(B3) 


The probability of error P e = 1 - P c . It should be noticed that Equation B3 could be derived from 
Equation C7 by letting B T = -oo. 
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Coherent Detection 


if 


and 


then 


= —= e -x ^ 2 

-00 < x < CO , 



J_ -(x s -A) 2 / 2 

-00 < X < 


s 


> 

I f(x) dx 

J-OD 


Results of this integral have been tabulated (Reference 3) for several combinations of 


Noncoherent Detection 

if 

f(r) = re'' 2,/2 0 i r < co 

and 

g(r) = 1 0 ( r A ) 0 ^ r < oo , 

then 

P c = J re" (r2+A2)/2 I 0 (rA)^J te' 1 ^ 2 dt^ dr 


= f re - (r2+A2)/2 I„ (rA) (l- e^^ 2 )" ' dr 

Jo 

= fre-(' 2+A2 > /2 I 0 (rA)2(-l)>'( n i ; 1 ) 

•'o k=0 

= 22 ( _1 ) k ("k a < 1+fc ) +A V 2 I 0 (rA) dr 


e~ kr /2 dr 


and A. 
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« 

By using new variables r', A' such that r' A' = rA and r 2 (l +k) = r ' 2 , 


r Vl + kA' = rA , 


A' 


A 

Vl +k 


and 


P 


k=0 0 


P 

c 


T' (-i) k 


k“0 


(n- 1\ e -kA 2 /[2(lt k) ] 

\ k ) 1 + k 


' A' ) dr' ; 
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Appendix C 


DISTRIBUTIONS OF Bj, B 4 , AND Bg 


The expressions for the probability of error P e and the probability of correct decision P c are 
derived for each of the ratios mentioned in the section on new statistical tests by using the results 
of the section on distributions. The first statistic is the ratio of the difference between the largest 
sample point and the population mean to the population standard deviation. Since population mean 
and variance is used, it has been assumed in this case that /x and cr are known; thus 


X . . “ UL 

(n) ^ 


X 


"Is 


(Cl) 

(C2) 


and 


X L 


1L 


(C3) 


Without loss of generality, one can let fi = 0 and a- = 1; the statistics involved here are x L and x s . 
Since x L and x s are independent, 


f ( X L’ X s) - f L ( X L ) ( X s ) 

f x K) { s ( X J - (C4) 

where f x (t), F x (t) are the noise pdf and cdf respectively, and f s (t), F s (t) are the signal pdf and 
cdf respectively. Applying the transformation 


(n- 1) 


£ 


f x <‘) dt 


= B 


1 S 


gives 


iji = i . 


r B u 

r x L 

1 ("• 1 ) f .( B ..) f ,W 

f x (t)dt 

■'-CO 

J - 00 


(C5) 
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Identifying 


(n-i) f x (x L ) f 
J -00 


f x (t)dt 


n-2 


dx 


L 


(C6) 


as 


»{[ F , (-L )]""} 


gives 




f S ( B ls) jj S d {[ F ‘ K)]"" 1 } = f s( B ls)[ F x ( B u)] 


-00 < B, 

Is 


< 00 


and 


P 

c 




P e is the probability that b l >b t and x L >x s . Applying the transformation 


(C7) 


I J I = i 


and using Equation C4 gives 


f( B J 


■£ 


(n-l)f x ( B L)[ F , ( B L)] n_2 f s ( x s) dx s 


—oo < B jL < oo 


and 


f°° f B L 

Pe = J ftBjdBn. = (n-l)J e f x (B L )[F x (B L )] n ' 2 f s (xJdx s dB L 


= { ("“ Df, ( B l) [ F x ( B l )]"" 2 J J f. (x s )dx s . 


(C8) 
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* The first ratio of the second group is the one having a in the denominator, thus assuming that 
a is known. Thus, 


X ( n ) X (n-1) 


(C9) 


For a- = 1, 


and 


B- - x x T 

4s s L 


4L 


- Y - X L " X L-1 - if X s < X L- 1 ; 

Z = X L - X s , if X L .J < X s < X L 


Applying the transformation, 


(CIO) 


x - x ; 


X L " X " B 4s 


IjI = i . 

Using the results of the section on distributions and Equation C4 gives 

f ( B 4s) = f f ( x s = x - x L = X - B 4s ) dx 
J -00 


r 

r x_B 4s 

(n- l)f s (x)f x (x-B 4 J 

1 f, (t)dt 

J -CD 

J -oo 


n-2 


dx -00 < B, < 00 

4s 


and 


r a r a r x ~ B 4, 

= (n-l)dB f s (x)f x (x-B 4 J f x (t)dt 

J R _ J -00 J -00 


dx . 


(Cll) 


To find P e , we have to use the joint density of x s , x L , and x L-1 which is (References 11, 14) 

f ( X L> X L-1 - X s) = f ( X L- X L-l) f s ( X s) • 

- (n-l)<n-2)[F x (x L _ 1 )] n3 f x (x L )f x (x M )f s (x s ) . 
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where 


—oo < x L _ 1 < 00 , -00 < X L < ro , and -00 < X s < 0 ° 


If x< < x L _j, apply the transformation 


X L-1 X ^ ’ 

III = l ; 


thus 


= f f(Y, x, x s )dY 
Jb t 

m x L-l =x ' Y 

f( x L = x,x L _, = X-Y, X s = X S )|J| dx s dxdY 

_T -00 

J »C0 /.CO /*x-Y 

dY (n- l)(n-2) [F x (x-Y)] n_3 f x (x)f x (x-Y)dx f s (xjdx s 

B oo J-oo 


If x L-1 < x s < x L , apply the transformation 


thus 


X L - X 

= X - Z ; 

I J I = 1 ; 

/.co ,00 /.x =x-z 


/•oo /»00 . 00 /*x s =X-Z 

= f (z, X, x L .j) dz = f (x L = x, X L _J = t, X s = X- z) |j| dt dx dZ 

j B x ^B t -'-coJ-oo 

-co /-co /-x-Z 

= dZ (n- 1) (n -2) f x (x) f s (x-Z) dx f x ( t ) [F x ( t )] n ' 3 dt 

•J B t •'-co J -oo 

/. OO /.CO 

= dZ (n-l)f x (x)f s (x-Z)[F x (x-Z)]"- 2 . 

•' B^- •'-oo 


(C12) 


(C13) 
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Of course, 


P 


e 


P + p 

e l e 2 


(C14) 


The last ratio to be theoretically investigated is B 6 . Although this ratio appears to depend on 
only three statistics, it is a function of all n order statistics because they must all be known in 
order to find X(1) , x (nM) , and X(n) . Since 


B 


6 


X (n) X (n- 1 ) 
X (n) ~ X (l) 


when x = x, N# 

s (n)> 


X - X,, . 

s ( 1 ) 


(C15) 


In this case, we need f(x L> x (1) ) which is 
f K’ x <d) = ( n -D( n -2)[F x (x L )-F x ( Xl )] n ' 3 f( X(1) )f( XL ) 

Applying the transformation 


X (l) < 00 ■ < x L 


gives 


X s ■ X (l) - W 
X s ‘ X L = wB 6s . 


I 


X s - X 
Xj = X " W 


x T - x - wB_ 

L 6 s 


IjI 


= J f KJ 


dB. 


m co 

(n-l)(n-2)f(x 1 = x-w, x L = x - wB 6s t x g = x ) |w| dw dx dB gs . 

The upper limit of the first integral is 1 because 0 < B 6 < 1, and the lower limit of the last integral 
is zero because the range w is always non-negative; making the proper substitutions: 


r 1 r 00 /*°° -x l =x-wB 

’c = (n- l)(n-2)dB 6 I f s (x) dx 

•'B- J 0 «/x , =: 


f x (t)dt 


f x (x -w) f x (x - wB) w dw . (C16) 
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For the P e 's we shall need f (x (1) , x L _,, xjwhich is 


1 ( x ( i) ' x L -i' x l) = (n- l)(n- 2)(n-3) [f, (x^J-F, ( x (1) )]" * f„ ( x (1) ) f, ( x l-i ) f x ( x l) 

for x (1) , x L , x L _, in (-00, oo ). Thus 


B 


6L 


fv 


< 



if x £ x- , and 

s L 1 



L- 1 


If x s £x l „ 1 apply the transformation 


(C17) 





I J I - |w| - w . 


The joint density of x (1) , x L _j, x L is 

1 ( x (l)> x l-i ' x l ) _ (n _ 1 ) (n - 2) (n -3 ) [F x (x L _j ) - F x (x (1) )J f x ( x (i)) ( x L-i ) ( x l) 

for x (1) , X L „,, X L in (-co, oo); 


wY 

f(x 0) = X-W, X L _, = X-wY, X L = x, x s = x s ) | J | dx s dwdx 

-OO 


for 0 IB <1, and P becomes: 


m 00 y»X“wY 

«.«•)* 

5 ^x-w 


f (x~w)f (x - wY) f x (x) w dwdx dY 


/•x~wY 

U x ,) 

J - CO 


dx s • (C18) 


If x L .j < X s < X L , apply the transformation 


X 


L 


X 


(1) 


- x - w 
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X 


x - wZ 


IjI = w 


Then f 2 (b 6L ) becomes 


m x g =x"wZ 

f C x ( I) = *-*. x L -i " x L-i> x l = x ’ X S = x_ wZ)ljl dx L _j dwdx 

-CO 


0 < B fiT < 1 and P becomes 

6L. e j 


-1 -oo -oo 

■ wtUi 


f (x)f (x-w)f (x- wZ)w dwdx dZ 


r x_wZ r* l-i 

| f x( X L-l) f x(t) dt 

-'x~w -'x-w 


dx L-l 


w: 

The probability of error is 


(n - 1) (n- 2) | dZ I f x (x) dx f s (x- wZ) f x (x - w) w 

B t J-oo •'0 


-x-w Z 
J x~w 


f x 


dw . 


(C19) 


P = P + P 

e e , e „ 


(C20) 
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Appendix D 


OUTLIERS 


In this type of approach, we shall assume k noise signals and find the probability of erroneously 
deciding that the largest noise statistic comes from another distribution. This probability has been 
previously defined as a 0 ; thus 

a Q = P(B>B T |all k signals came from e co ) • (Dl) 

Having found a 0 , 1 - a 0 is the confidence with which we accept x (k) as the signal. Thus 


a 


0 



For B = Bj , 


(D2) 


r 

r L 

a 0 = kf x ( X l) 

Jb t 

fx(t)dt 

J -CD 


(D3) 


C Bt r* 

- a 0 = kf x( X ) f x(‘)dt 

J —00 00 


dx 


[ F x( B T )] n 


(D4) 


The only pdf is the noise pdf; therefore we shall drop the subscript in this appendix. To simplify 
notation, we shall also drop the parentheses about the subscripts. 

For B = B 4 , apply the transformation 


X 


k 


X 


X 


k-1 


X - B 


IjI = i 
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Thus 


f(B) = 



x k _j - x - B ) dx 


-oo < B < oo 


- [ k(k- l)[F(x k _j)] k 2 f(x k ) f(x k _ 1 ) dx k 

•'-CO J 


r 

rx-B 

k(k-i> 

J -CO 

f(t>dt 

J-CD 


k-2 


f (x) f (x ~ B) dx 


-■r 


f (B) dB , 


(D5) 


and 


1 - a 


0 


t b t 

f (B) dB . 

J -CD 


(D6) 


For B = B 6 , apply the transformation 


X 


k 


X 


X 1 “ X - w 


X 


k -1 


x - Bw 


IjI = lw| . 


Thus 


f(B) 


f k(k- l)(k-2) [F(x k . 1 )-F(x 1 )l k 3 f(x,) f(x k _ 1 ) f(x k ) , 0<B<1 

J -oo 


then 


s-r 


k(k- 1) (k - 2) dB 


r°° r™ /»x“Bw 
dx w 

" Q J x -W 


f(t)dt 


k -3 


f(x)f(x-w)f(x- Bw) dw 


(D7) 
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and 


(-.) - f 

•'n 


k(k - 1) (k- 2)dB 


r 00 Z * 00 /*x'Bw 

ioo dX J„ W L 


f(t)dt 


f(x) f(x-w) f(x-Bw)dw . ( D8 ) 
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Appendix E 


TABULATED AND GRAPHICAL RESULTS 


This appendix contains both the theoretical and the experimental results in the form of tables 
and graphs. 
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Table El 


Theoretical Results, B l Coherent. 




Table E2 


Theoretical Results, B 


n = 16 


0 . 

0.4 

0.8 

1.2 

1.6 


2.0 


2.4 

2.8 


3.2 

3.6 

4.0 

4.4 

4.8 


5.2 


5.6 

6.0 


A 

= 1 

A 

= 2 

A 

= 3 

A s 

4 

p . 

p . 

p . 

Pc 

p 

Pc 

P e 

P c 

0.740 

0.260 

0.405 

0.594 

0.134 

0.866 

0.025 

0.974 

0.334 

0.159 

0.172 

0.455 

0.052 

0.777 

0.088 

0.947 

0.134 

0.087 

0.065 

0.321 

0.184 

0.660 

0.027 

0.899 

0.047 

0.043 

0.022 

0.206 

0.057 

0.525 

0.000 

0.825 

0.015 

0.019 

0.066 

0.119 

0.016 

0.386 


CM 

CM 

r- 

© 

0.004 

0.007 

0.001 

0.625 

0.000 

0.260 


0.594 

0.001 

0.002 

0.000 

0.029 


0.159 


0.455 

0.000 

0.000 


0.012 


0.087 


0.321 




0.004 


0.043 


0.206 




0.001 


0.019 


0.119 




0.000 


0.007 


0.062 






0.002 


0.029 






0.000 


0.012 








0.004 








0.001 








0.000 


n = 64 



A = 

= 1 

A = 

= 2 

A 

= 3 

B T 

p . 

Pc 

p . 

Pc 

p . 

Pc 

0. 

0.891 

0.110 

0.620 

0.381 

0.272 

0.728 

0.4 

0.323 

0.055 

0.218 

0.251 

0.090 

0.597 

0.8 

0.102 

0.024 

0.067 

0.149 

0.026 

0.452 

1.2 

0.028 

0.009 

0.018 

0.079 

0.006 

0.313 

1.6 

0.006 

0.003 

0.004 

0.037 

0.001 

: 0.196 

2.0 

0.001 

0.000 

0.000 

0.015 

0.000 

0.110 

2.4 

0.000 



0.005 


0.055 

2.8 




0.001 


0.024 

3.2 




0.000 


0.009 

3.6 






0.003 

4.0 






0.000 

4.4 







4.8 







5.2 








A = 4 


p . 

Pc 

0.066 

0.934 

0.020 

0.874 

0.056 

0.785 

0.001 

0.665 

0.000 

0.525 

0.381 


Coherent. 


n = 32 


A 

= 1 

A 

= 2 

A 

3 

A 

= 4 

P 

e 

P c 

P e 

P 

c 

P e 

P 

C 

P e 

P c 

0.830 

0.171 

0.518 

0.482 

0.198 

0.802 

0.042 

0.957 

0.334 

0.094 

0.200 

0.343 

0.717 

0.689 

0.013 

0.915 

0.118 

0.046 

0.068 

0.221 

0.023 

0.554 

0.041 

0.847 

0.037 

0.020 

0.020 

0.129 

0.657 

0.411 

0.010 

0.749 

0.010 

0.007 

0.054 

0.067 

0.016 

0.279 

0.000 

0.623 

0.002 

0.002 

0.001 

0.031 

0.000 

0.171 


0.482 

0.000 

0.000 

0.000 

0.012 


0.094 


0.343 




0.004 


0.046 


0.221 




0.001 


0.020 


0.129 




0.000 


0.007 


0.067 






0.002 


0.031 






0.000 


0.012 








0.004 








0.001 








0.000 


n = 128 


A 

= 1 

A : 

- 2 

A = 

■ 3 

A 

= 4 

p . 

Pc 

p . 

P c 

p . 

Pc 

P e 

Pc 

0.932 

0.069 

0.708 

0.298 

0.352 

0.648 

0.097 

0.902 

0.306 

0.032 

0.227 

0.180 

0.108 

0.505 

0.028 

0.824 

0.088 

0.012 

0.064 

0.098 

0.029 

0.360 

0.007 

0.714 

0.022 

0.004 

0.015 

0.048 

0.007 

0.233 

0.001 

0.578 

0.004 

0.001 

0.003 

0.020 

0.001 

0.135 

0.000 

0.431 

0.000 

0.000 

0.000 

0.007 

0.000 

0.069 


0.293 


0.032 

0.012 

0.004 


< 

i 

































Table E4 


Theoretical Results, ] 


n = 16 



A 

= 1 

A 

- 2 

A = 

3 

A 

4 

Pe 

P c 

Pe 

P c 

Pe 

P c 

Pe 

P c 


0.858 

0.141 

0.603 

0.396 

0.275 

0.723 

0.722 

0.927 

0.4 

0.858 

0.141 

0.603 

0.396 

0.275 

0.723 

0.722 

0.927 

0.8 

0.858 

0.141 

0.603 

0,396 

0.275 

0.723 

0.722 

0.927 

1.2 

0.858 

0.141 

0.603 

0.396 

0.275 

0.723 

0.722 

0.927 

1.6 

0.854 

0.141 

0.602 

0.395 

0.275 

0.723 

0.722 

0.927 

2.0 

0.783 

0.134 

0.566 

0.388 

0.266 

0.720 

0.711 

0.926 

2.4 

0.536 

0.103 

0.416 

0.346 

0.215 

0.694 

0.631 

0.919 

2.8 

0.250 

0.059 

0.211 

0.255 

0.127 

0.611 

0.440 

0.890 

3.2 

0.084 

0.026 

0.077 

0.154 

0.053 

0.476 

0.229 

0.818 

3.6 

0.022 

0.009 

i 0.021 

0.078 

0.017 

0.325 

0.901 

0.700 

4.0 

0.005 

0.002 

0.004 

0.034 

0.004 

0.196 

0.272 

0.549 

4.4 

0.000 

0.000 

0.000 

0.012 

0.000 

0.103 

0.000 

0.389 

4.8 




0.004 


0.047 


0.246 

5.2 




0.001 


0.019 


0.137 

5.6 




0.000 


0.006 


0.067 

6.0 






0.001 


0.028 

6.4 






0.000 


0.010 

6.8 








0.003 

7.2 








0.000 


n = 64 



A = 

= 1 

A : 

= 2 

A = 

= 3 

A = 

= 4 

Pe 

Pc 

Pe 

P c 

P e 

P c 

Pe 

P c 

0. 

0.948 

0.051 

0.781 

0.218 

0.453 

0.546 

0.154 

0.844 

0.4 

0.948 

0.051 

0.781 

0.218 

0.453 

0.546 

0.154 

0.844 

0.8 

0.948 

0.051 

0.781 

0.218 

0.453 

0.546 

0.154 

0.844 

1.2 

0.948 

0.051 

0.781 

0.218 

0.453 

0.546 

0.154 

0.844 

1.6 

0.948 

0.051 

0.781 

0.218 

0.453 

0.546 

0.154 

0.844 

2.0 

0.948 

0.051 

0.781 

0.218 

0.453 

0.546 

0.154 

0.844 

2.4 

0.926 

0.050 

: 0.767 

0.217 

0.448 

0.545 

0.153 

0.844 

2.8 

0.694 

0.042 

0.597 

0.198 

0.372 

0.527 

0.136 

0.837 

3.2 

0.309 

0.023 

0.282 

0.140 

0.199 

0.448 

0.086 

0.794 

3.6 

0.091 

0.009. 

0.087 

0.076 

0.069 

0.320 

0.036 

0.693 

4.0 

0.020 

0.002 

0.020 

0.033 

0.017 

0.195 

0.011 

0.547 

4.4 

0.003 

0.000 

0.003 

0.012 

0.003 

0.103 

0.002 

0.389 

4.8 

0.000 


0.000 

0.004 

0.000 

0.047 

0.000 

0.246 

5.2 




0.001 


0.019 


0.137 


5.6 

6.0 

6.4 

6.8 

7.2 


0.000 


Noncoherent. 


n = 32 


A 

1 

A = 

2 

A = 

3 

A = 

4 

Pe 

Pc 

P e 

P c 

P e 

Pc 

P e 

Pc 

0.914 

0.085 

0.702 

0.297 

0.364 

0.635 

0.109 

0.890 

0.914 

0.085 

0.702 

0.297 

0.364 

0.635 

0.109 

0.890 

0.914 

0.085 

0.702 

0.297 

0.364 

0.635 

0.109 

0.890 

0.914 

0.085 

0.702 

0.297 

0.364 

0.635 

0.109 

0.890 

0.914 

0.085 

0.702 

0.297 

0.364 

0.635 

0.109 

0.890 

0.906 

0.085 

0.698 

0.297 

0.363 

0.635 

0.109 

0.890 

0.779 

0.077 

0.619 

0.285 

0.336 

0.628 

0.104 

0.888 

0.446 

0.052 

0.380 

0.233 

0.230 

0.579 

0.081 

0.870 

0.167 

0.025 

0.152 

0.149 

0.106 

0.466 

0.045 

0.809 

0.046 

0.009 

0.044 

0.077 

0.035 

0.323 

0.018 

0.697 

0.010 

0.002 

0.010 

0.034 

0.008 

0.195 

0.005 

0.548 

0.001 

0.000 

0.001 

0.012 

0.001 

0.103 

0.001 

0.389 

0.000 


0.000 

0.004 

0.000 

0.047 

0.000 

0.246 




0.001 


0.019 


0.137 




0.000 


0.006 


0.067 






0.001 


0.028 






0.000 


0.010 








0.003 








0.000 




n = 

128 




A 

= 1 

A = 

= 2 

A 

= 3 

A 

= 4 

Pe 

P c 

Pe 

P c 

p. 

P c 

p. 

P c 

0.969 

0.030 

0.841 

0.158 

0.538 

0.461 

0.207 

0.791 

0.969 

0.030 

0.841 

0.158 

0.538 

0.461 

0.207 

0.791 

0.969 

0.030 

0.841 

0.158 

0.538 

0.461 

0.207 

0.791 

0.969 

0.030 

0.841 

0.158 

0.538 

0.461 

0.207 

0.791 

0.969 

0.030 

0.841 

0.158 

0.538 

0.461 

0.207 

0.791 

0.969 

0.030 

0.841 

0.158 

0.538 

0.461 

0.207 

0.791 

0.968 

0.030 

0.841 

0.158 

0.538 

0.461 

0.207 

0.791 

0.897 

0.029 

0.788 

0.154 

0.514 

0.458 

0.202 

0.790 

0.525 

0.020 

0.481 

0.125 

0.342 

0.417 

0.150 

0.767 

0.176 

0.008 

0.168 

0.073 

0.134 

0.312 

0.070 

0.684 

0.041 

0.002 

0.040 

0.033 

0.035 

0.194 

0.022 

0.545 

0.007 

0.000 

0.007 

0.012 

0.007 

0.103 

0.005 

0.388 

0.001 


0.001 

0.004 

0.001 

0.047 

0.001 

0.246 

0.000 


0.000 

0.001 

0.000 

0.019 

0.000 

0.137 


1.067 
). 028 
).010 
).003 
).000 



Table E5 


Theoretical Results, B 4 Noncoherent. 




Table E6 


Theoretical Results, B 6 Noncoherent. 


n = 16 

b t 

A - 

1 

A = 

2 

A = 

3 

A = 

4 

P 

e 

p 

c 

P 

e 

Pc 

Pe 

P 

c 

P 

e 

P 

c 

0 

0.857 

0.143 

0.610 

0.390 

0.279 

0.721 


0.927 

0.1 

0.541 

0.099 

0.365 

0.313 

0.154 

0.638 


0.882 

0.2 

0.292 

0.061 

0.188 

0.226 

0.073 

0.529 


0.814 

0.3 

0.130 

0.032 

0.079 

0.141 

0.028 

0.395 


0.703 

0.4 

0.043 

0.013 

0.025 


0.008 

0.247 


0.536 

0.5 

0.009 

0.003 

0.005 


0.001 

0.112 


0.319 

0.6 

0.001 

0.000 



0.000 

0.029 


0.116 

0.7 

0.009 

0.000 




0.003 



0.8 






0.000 



0.9 









1.0 









n = 32 


A = 

i 

A = 

2 

A = 

3 

A = 

4 










T 










P 

P r 

P 

P 

P 

P 

P 

P 




e 

c 

e 

c 

e 

c 

0 

0.902 

0.106 

0.703 

0.297 

0.364 

0.636 

0.109 

0.891 

0.1 

0.481 

0.052 

0.357 

0.213 

0.172 

0.528 

0.047 

0.823 

0.2 

0.204 

0.026 

0.145 

0.133 

0.065 

0.399 

0.016 

0.723 

0.3 

0.064 

0.010 

0.043 

0.067 

0.018 

0.255 

0.004 

0.570 

0.4 

0.013 

0.003 

0.008 

0.024 

0.003 

0.122 

0.001 

0.365 

0.5 

0.001 

0.000 

0.001 

0.005 

0.000 

0.035 

0.000 

0.155 

0.6 

0.000 

0.000 

0.000 

0.000 


0.004 


0.001 

0.7 






0.000 


0.000 

0.8 









0.9 









1.0 









n = 64 

B t 

A = 

1 

A = 

2 

A = 

3 

A = 

4 


P 

P 

P 

P 

P 

P 

P 

P 



c 

e 

c 

e 

c 

e 

c 

0 

0.949 

0.051 

0.782 

0.218 

0.453 

0.547 

0.160 

0.840 

0.1 

0.416 

0.027 

0.333 

0.141 

0.183 

0.423 

0.057 

0.754 

0.2 

0.138 

0.011 

0.107 

0.075 

0.055 

0.287 

0.016 

0.621 

0.3 

0.030 

0.003 

0.023 

0.030 

0.011 

0.154 

0.003 

0.437 

0.4 

0.003 

0.001 

0.002 

0.007 

0.001 

0.055 

0.000 

0.227 

0.5 

0.000 

0.000 

0.000 

0.001 


0.009 


0.064 

0.6 






0.000 


0.005 

0.7 








0.000 

0.8 









0.9 









1.0 
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Table E7 


Experimental Results, B Coherent. 


n = 64 
A = 2 



0. 

0.882 

0.118 

0.620 

0.380 

0.270 

0.730 

0.076 

0.924 

0.935 

0.065 

0.709 

0.291 

0.383 

0.617 

0.089 

0.911 

0.4 

0.882 

0.118 

0.620 

0.380 

0.270 

0.730 

0.076 

0.924 

0.935 

0.065 

0.709 

0.291 

0.383 

0.617 

0.089 

0.911 

0.8 

0.882 

0.118 

0.620 

0.380 

0.270 

0.730 

0.076 

0.924 

0.935 

0.065 

0.709 

0.291 

0.383 

0.617 

0.089 

0.911 

1.2 

0.881 

0.118 

0.620 

0.380 

0.270 

0.730 

0.076 

0.924 

0.935 

0.065 

0.709 

0.291 

0.383 

0.617 

0.089 

0.911 

1.6 

0.862 

0.118 

0.612 

0.377 

0.269 

0.730 

0.076 

0.924 

0.935 

0.064 

0.709 

0.291 

0.383 

0.617 

0.089 

0.911 

2.0 

0.700 

0.103 

0.529 

0.358 

0.245 

0.721 

0.071 

0.921 

0.894 

0.064 

0.679 

0.290 

0.380 

0.617 

0.087 

0.911 

2.4 

0.382 

0.069 

0.313 

0.284 

0.160 

0.671 

0.052 

0.907 

0.623 

0.050 

0.492 

0.266 

0.312 

0.600 

0.081 

0.907 

2.8 

0.128 

0.038 

0.120 

0.190 

0.070 

0.574 

0.038 

0.868 

0.294 

0.026 

0.226 

0.189 

0.176 

0.509 

0.045 

0.877 

3.2 

0.044 

0.019 

0.034 

0.101 

0.024 

0.415 

0.017 

0.771 

0.097 

0.009 

0.077 

0.109 

0.059 

0.387 

0.022 

0.790 

3.6 

0.007 

0.007 

; 0.008 

0.048 

0.008 

0.273 

0.004 

0.643 

0.023 

0.003 

0.019 

0.049 

0.015 

0.247 

0.008 

0.674 

4.0 

0.000 

0.000 

0.003 

0.016 

0.002 

0.155 

0.000 

0.501 

0.006 

0.002 

0.004 

0.024 

0.002 

0.144 

0.001 

0.515 




0.001 

0.003 

0.000 

0.085 


0.353 

0.001 

0.000 

0.001 

0.005 

0.000 

0.073 

0.000 

0.379 




0.000 

0.000 


0.035 


0.198 

0.000 


0.001 

0.002 


0.022 


0.241 







0.014 


0.099 



0.000 

0.000 


0.010 


0.141 
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Table E8 

Experimental Results , B 2 Coherent . 




n = If 

i 

n = 32 

B t 

A 

- 1 

■ 

= 2 

1 

m 


A = 1 

warn 

A = 3 

I A = 4 


P 

C 

P e 

P 

c 

D 







P 

c 

P e 

P c 


n 

0 . 

0.4 

0.8 

1.2 

1.6 

2.0 

2.4 

2.8 

3.2 

3.6 

4.0 

0.740 

0.740 

0.740 

0.691 

0.507 

0.300 

0.119 

0.038 

0.007 

0.002 

0.000 

0.260 

0.260 

0.260 

0.253 

0.213 

0.155 

0.085 

0.040 

0.015 

0.006 

0.003 

0.002 

0.001 

0.000 

0.405 

0.405 

0.404 

0.389 

0.312 

0.194 

0.092 

0.030 

0.009 

0.002 

0.000 



0.880 

0.880 

0.880 

0.880 

0.864 

0.825 

0.720 

0.591 

0.427 

0.288 

0.177 

0.096 

0.044 

0.016 

0.006 

0.003 

0.001 

0.001 

0.000 

0.022 

0.022 

0.022 

0.022 

0.020 

0.016 

0.010 

0.004 

0.000 

0.978 

0.978 

0.978 

0.978 

0.976 

0.966 

0.937 

0.877 

0.779 

0.642 

0.494 

0.349 

0.218 

0.123 

0.059 

0.028 

0.008 

0.003 

0.001 

0.001 

0.000 

0.811 

0.811 

0.811 

0.811 

0.732 

0.476 

0.205 

0.068 

0.018 

0.001 

0.000 

0.189 

0.189 

0.189 

0.189 

0.179 

0.139 

0.071 

0.032 

0.011 

0.005 

0.000 

0.519 

0.519 

0.519 

0.517 

0.468 

0.329 

0.162 

0.058 

0.021 

0.006 

0.000 

0.481 

0.481 

0.481 

0.481 

0.470 

0.417 

0.326 

0.220 

0.118 

0.056 

0.022 

0.010 

0.006 

0.002 

0.001 

0.000 

0.202 

0.202 

0.202 

0.201 

0.190 

0.147 

0.083 

0.033 

0.016 

0.004 

0.001 

0.000 

0.798 

0.798 

0.798 

0.798 

0.795 

0.769 

0.677 

0.559 

0.403 

0.259 

0.143 

0.072 

0.036 

0.015 

0.006 

0.002 

0.001 

0.000 

0.050 

0.050 

0.050 

0.050 

0.050 

0.042 

0.027 

0.017 

0.007 

0.002 

0.001 

0.000 

0.950 

0.950 

0.950 

0.950 

0.950 

0.943 

0.920 

0.869 

0.766 

0.644 

0.507 

0.347 

0.221 

0.127 

0.070 

0.033 

0.008 

0.004 

0.001 

0.000 








n = 

128 




B t 

A 

= 1 

A 

m 

A = 3 

A = 4 

A = 1 

A = 2 

A = 3 

A = 4 

P e 

P c 

P e 

P 

c 

P e 

P 

c 

P e 

P 

c 

P e 

P c 

P e 

P 

C 

P e 

P c 

P e 

P 

c 

0 . 

0.4 

0.8 

1.2 

1.6 

2.0 

2.4 

2.8 

3.2 

3.6 

4.0 

0.882 

0.882 

0.882 

0.882 

0.874 

0.710 

0.378 

0.140 

0.043 

0.009 

0.002 

0.000 

0.118 

0.118 

0.118 

0.118 

0.118 

0.100 

0.074 

0.040 

0.021 

0.007 

0.000 

0.620 

0.620 

0.620 

0.620 

0.615 

0.530 

0.315 

0.121 

0.039 

0.009 

0.001 

0.001 

0.000 

0.380 

0.380 

0.380 

0.380 

0.377 

0.365 

0.285 

0.182 

0.106 

0.044 

0.014 

0.002 

0.000 

0.270 

0.270 

0.270 

0.270 

0.270 

0.246 

0.155 

0.062 

0.019 

0.006 

0.002 

0.001 

0.000 

0.730 

0.730 

0.730 

0.730 

0.729 

0.725 

0.672 

0.565 

0.482 

0.269 

0.161 

0.086 

0.039 

0.014 

0.004 

0.002 

0.000 

0.076 

0.076 

0.076 

0.076 

0.076 

0.070 

0.053 

0.035 

0.014 

0.003 

0.000 

0.924 

0.924 

0.924 

0.924 

0.924 

0.922 

0.910 

0.867 

0.773 

0.649 

0.506 

0.346 

0.205 

0.100 

0.037 

0.016 

0.005 

0.000 

0.935 

0.935 

0.935 

0.935 

0.935 

0.895 

0.642 

0.296 

0.093 

0.027 

0.007 

0.002 

0.000 

0.065 

0.065 

0.065 

0.065 

0.064 

0.064 

0.052 

0.025 

0.011 

0.003 

0.002 

0.000 

0.709 

0.709 

0.709 

0.709 

0.709 

0.684 

0.508 

0.212 

0.079 

0.018 

0.004 

0.001 

0.000 

0.291 

0.291 

0.291 

0.291 

0.291 

0.289 

0.265 

0.190 

0.111 

0.054 

0.024 

0.008 

0.002 

0.000 

0.383 

0.388 

0.388 

0.388 

0.388 

0.382 

0.311 

0.168 

0.056 

0.017 

0.002 

0.000 

0.617 

0.617 

0.617 

0.617 

0.617 

0.617 

0.599 

0.514 

0.394 

0.248 

0.144 

0.068 

0.022 

0.012 

0.008 

0.003 

0.002 

0.000 

0.089 

0.089 

0.089 

0.089 

0.089 

0.087 

0.080 

0.046 

0.020 

0.005 

0.002 

0.000 

0.911 

0.911 

0.911 

0.911 

0.911 

0.911 

0.906 

0.881 

0.794 

0.664 

0.514 

0.370 

0.236 

0.138 

0.077 

0.033 

0.015 

0.009 

0.002 

0.000 
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Table E9 


Experimental Results , B 3 Coherent . 


n = 16 

n = 

32 



A = 1 

A = 2 

A = 3 

A = 4 

A = 1 

A = 

2 

A = 

3 

A = 

4 

B t 

P e 

Pc 

p . 

P c 

p 

P c 

p. 

P c 

P e 

P c 

P e 

P 

C 

P e 

P c 

P e 

P c 

0. 

0.4 

0.8 

1.2 

1.6 

2.0 

2.4 
2.8 

3.2 
3.6 
4.0 

4.4 
4.8 

5.2 

0.740 

0.740 

0.740 

0.739 

0.655 

0.458 

0.248 

0.117 

0.049 

0.020 

0.011 

0.007 

0.002 

0.000 

0.260 

0.260 

0.260 

0.260 

0.252 

0.203 

0.128 

0.080 

0.052 

0.030 

0.020 

0.009 

0.004 

0.001 

0.000 

0.405 

0.405 

0.405 

0.403 

0.367 

0.242 

0.136 

0.071 

0.034 

0.015 

0.006 

0.002 

0.001 

0.000 

0.595 

0.595 

0.595 

0.595 

0.584 

0.524 

0.414 

0.291 

0.199 

0.134 

0.089 

0.051 

0.031 

0.014 

0.007 

0.001 

0.001 

0.001 

0.000 

0.120 

0.120 

0.120 

0.120 

0.111 

0.086 

0.046 

0.019 

0.005 

0.001 

0.001 

0.001 

0.001 

0.001 

0.001 

0.001 

0.001 

0.000 

0.880 

0.880 

0.880 

0.880 

0.872 

0.839 

0.763 

0.634 

0.494 

0.384 

0.286 

0.195 

0.126 

0.084 

0.060 

0.035 

0.017 

0.012 

0.007 

0.004 

0.003 

0.002 

0.001 

0.000 

0.022 

0.022 

0.022 

0.022 

0.021 

0.017 

0.008 

0.002 

0.001 

0.000 

0.978 

0.978 

0.978 

0.978 

0.976 

0.971 

0.949 

0.888 

0.805 

0.695 

0.574 

0.463 

0.351 

0.252 

0.184 

0.137 

0.074 

0.062 

0.045 

0.033 

0.018 

0.011 

0.011 

0.008 

0.811 

0.811 

0.811 

0.811 

0.784 

0.599 

0.316 

0.123 

0.037 

0.010 

0.003 

0.000 

0.189 

0.189 

0.189 

0.189 

0.188 

0.160 

0.101 

0.040 

0.020 

0.007 

0.002 

0.001 

0.000 

0.519 

0.519 

0.519 

0.519 

0.508 

0,383 

0.199 

0.089 

0.031 

0.008 

0.003 

0.001 

0.000 

0.481 

0.481 

0.481 

0.481 

0.478 

0.444 

0.359 

0.260 

0.142 

0.076 

0.040 

0.028 

0.016 

0.008 

0.002 

0.000 

0.202 

0.202 

0.202 

0.202 

0.198 

0.166 

0.093 

0.043 

0.014 

0.003 

0.001 

0.000 

0.798 

0.798 

0.798 

0.798 

0.798 

0.784 

0.703 

0.582 

0.440 

0.304 

0.189 

0.116 

0.062 

0.032 

0.018 

0.007 

0.002 

0.001 

0.000 

0.050 

0.050 

0.050 

0.050 

0.050 

0.041 

0.026 

0.016 

0.006 

0.003 

0.001 

0.000 

0.950 

0.950 

0.950 

0.950 

0.950 

0.944 

0.923 

0.862 

0.775 

0.660 

0.537 

0.413 

0.278 

0.192 

0.126 

0.081 

0.041 

0.024 

0.014 

0.009 

0.004 

0.001 

0.000 




n = 64 


n = 

128 


b t 

A = 1 

A = 2 

A = 3 

A = 4 

A = 1 

A 

= 2 

A 

= 3 

A 

= 4 

P e 

Pc 

p . 

Pc 

P e 

P c 

p . 

P c 

P e 

P c 

P e 

P 

C 

P e 

P c 

P c 

P 

0. 

0.4 

0.8 

1.2 

1.6 

2.0 

2.4 

2.8 

3.2 

3.6 

4.0 

0.882 

0.882 

0.882 

0.882 

0.881 

0.797 

0.472 

0.211 

0.069 

0.022 

0.010 

0.003 

0.001 

0.000 

0.118 

0.118 

0.118 

0.118 

0.118 

0.110 

0.087 

0.045 

0.022 

0.009 

0.003 

0.000 

0.620 

0.620 

0.620 

0.620 

0.620 

0.573 

0.356 

0.146 

0.050 

0.012 

0.003 

0.001 

0.001 

0.001 

0.000 

0.380 

0.380 

0.380 

0.380 

0.380 

0.375 

0.310 

0.221 

0.127 

0.061 

0.024 

0.008 

0.003 

0.000 

0.270 

0.270 

0.270 

0.270 

0.270 

0.255 

0.167 

0.071 

0.019 

0.006 

0.003 

0.001 

0.000 

0.730 

0.730 

0.730 

0.730 

0.730 

0.725 

0.691 

0.578 

0.443 

0.313 

0.182 

0.121 

0.064 

0.032 

0.014 

0.006 

0.002 

0.000 

0.076 

0.076 

0.076 

0.076 

0.076 

0.070 

0.058 

0.035 

0.016 

0.004 

0.001 

0.000 

0.924 

0.924 

0.924 

0.924 

0.924 

0.923 

0.908 

0.874 

0.786 

0.677 

0.513 

0.361 

0.241 

0.135 

0.069 

0.035 

0.012 

0.008 

0.005 

0.001 

0.001 

0.000 

0.935 

0.935 

0.935 

0.935 

0.935 

0.921 

0.718 

0.342 

0.118 

0.034 

0.010 

0.004 

0.002 

0.000 

0.065 

0.065 

0.065 

0.065 

0.065 

0.063 

0.058 

0.027 

0.015 

0.007 

0.003 

0.001 

0.000 

0.709 

0.709 

0.709 

0.709 

0.709 

0.701 

0.546 

0.264 

0.088 

0.019 

0.004 

0.002 

0.001 

0.000 

0.291 

0.291 

0.291 

0.291 

0.291 

0.291 

0.266 

0.203 

0.118 

0.058 

0.027 

0.011 

0.003 

0.001 

0.001 

0.000 


0.617 

0.617 

0.617 

0.617 

0.617 

0.617 

0.604 

0.516 

0.392 

0.272 

0.161 

0.075 

0.035 

0.019 

0.011 

0.007 

0.003 

0.000 

0.089 

0.089 

0.089 

0.089 

0.089 

0.088 

0.080 

0.044 

0.020 

0.005 

0.001 

0.000 

0.911 

0.911 

0.911 

0.911 

0.911 

0.911 

0.905 

0.873 

0.796 

0.675 

0.527 

0.387 

0.254 

0.153 

0.089 

0.049 

0.021 

0.007 

0.001 

0.000 
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Table E10 


Experimental Results, B 4 Coherent. 




n = 16 

n = 32 

B t 

A 

= 1 

A 

= 2 

A 

= 3 

A 

= 4 

A 

= 1 

A 

= 2 

A 

= 3 

A 

= 4 


p. 

p 

P e 

Pc 

p. 

Pc 

p. 

P c 

p. 

Pc 

p. 

Pc 

P e 

P c 

P e 

Pc 

0. 

0.740 

0.260 

0.405 

0.595 

0.120 

0.880 

0.022 

0.978 

0.811 

0.189 

0.519 

0.481 

0.202 

0.798 

0.050 

0.950 

0.4 

0.357 

0.168 

0.172 

0.466 

0.047 

0.789 

0.003 

0.954 

0.314 

0.108 

0.192 

0.340 

0.069 

0.680 

0.015 

0.897 

0.8 

0.133 

0.091 

0.078 

0.336 

0.018 

0.686 

0.002 

0.910 

0.109 

0.041 

0.063 

0.228 

0.022 

0.539 

0.004 

0.828 

1.2 

0.049 

0.050 

0.027 

0.211 

0.006 

0.536 

0.001 

0.839 

0.028 

0.014 

0.017 

0.132 

0.004 

0.399 

0.002 

0.734 

1.6 

0.011 

0.018 

0.008 

0.124 

0.001 

0.393 

0.000 

0.747 

0.005 

0.005 

0.005 

0.063 

0.001 

0.248 

0.000 

0.621 

2.0 

0.001 

0.007 

0.001 

0.062 

0.001 

0.271 


0.610 

0.002 

0.003 

0.000 

0.032 

0.000 

0.145 


0.489 

2.4 

0.000 

0.003 

0.000 

0.025 

0.000 

0.163 


0.447 

0.000 

0.000 


0.017 


0.072 


0.355 

2.8 


0.001 


0.008 


0.091 


0.326 




0.008 


0.032 


0.234 

3.2 


0.000 


0.003 


0.045 


0.209 




0.003 


0.018 


0.142 

3.6 






0.022 


0.122 




0.001 


0.010 


0.074 

4.0 






0.004 


0.064 




0.001 


0.001 


0.036 

4.4 






0.001 


0.026 




0.000 


0.000 


0.015 

4.8 






0.000 


0.010 








0.006 

5.2 








0.006 








0.001 









0.002 








0.000 









0.001 

















0.000 










n = 64 

n = 128 




EL 

A 

= 1 

A 

= 2 

A 

= 3 

A 

= 4 

A 

= 1 

A 

= 2 

A 

= 3 

A 

= 4 

T 

P e 

P 

c 

p. 

P c 

p. 

Pc 

p. 

Pc 

P e 

P c 

p 

P c 

P e 

P c 

p 

P c 

0. 

0.882 

0.118 

0.620 

0.380 

0.270 

0.730 

0.076 

0.924 

0.935 

0.065 

0.709 

0.291 

0.383 

0.617 

0.089 

0.911 

0.4 

0.310 

0.061 

0.224 

0.249 

0.082 

0.605 

0.033 

0.868 

0.321 

0.036 

0.226 

0.171 

0.116 

0.491 

0.025 

0.837 

0.8 

0.105 

0.026 

0.061 

0.144 

0.018 

0.454 

0.011 

0.786 

0.099 

0.013 

0.060 

0.095 

0.028 

0.342 

0.006 

0.718 

1.2 

0.026 

0.011 

0.012 

0.075 

0.006 

0.332 

0.005 

0.665 

0.027 

0.004 

0.014 

0.047 

0.002 

0.216 

0.003 

0.582 

1.6 

0.007 

0.001 

0.004 

0.027 

0.003 

0.210 

0.001 

0.521 

0.007 

0.002 

0.004 

0.017 

0.001 

0.124 

0.000 

0.460 

2.0 

0.003 

0.000 

0.002 

0.011 

0.001 

0.116 

0.000 

0.378 

0.004 

0.000 

0.001 

0.008 

0.001 

0.059 


0.310 

2.4 

0.000 


0.000 

0.001 

0.000 

0.055 


0.244 

0.000 


0.001 

0.002 

0.000 

0.026 


0.201 

2.8 




0.001 


0.023 


0.143 



0.000 

0.000 


0.014 


0.118 

3.2 




0.000 


0.008 


0.060 






0.003 


0.058 

3.6 






0.004 


0.025 






0.001 


0.029 

4.0 






0.001 


0.016 






0.001 


0.013 







0.000 


0.002 






0.001 


0.001 









0.000 






0.000 


0.001 

















0.000 
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Table Ell 


Experimental Results , B g Coherent . 


n = 16 

n = 32 

B t 

A 

= 1 

A 

= 2 

A 

= 3 

A 

- 4 

A 

= 1 

A 

= 2 

A 

= 3 

A 

= 4 

T 

P 

P 

P 

P 

P 

P 

P 

P 

P 

P 

P 

P 

P 

P 

P 

P 


* 

C 

e 

e 

C 

C 


c 



e 



c 



0 . 

0.740 

0.260 

0.405 

0.595 

0.120 

0.880 

0.022 

0.978 

0.811 

0.189 

0.519 

0.481 

0.202 

0.798 

0.050 

0.950 

0.4 

0.395 

0.184 

0.189 

0.469 

0.046 

0.792 

0.008 

0.955 

0.346 

0.112 

0.206 

0.345 

0.073 

0.686 

0.015 

0.894 

0.8 

0.197 

0.106 

0.097 

0.356 

0.021 

0.695 

0.002 

0.907 

0.137 

0.048 

0.074 

0.233 

0.028 

0.543 

0,005 

0.828 

1.2 

0.084 

0.064 

0.049 

0.256 

0.008 

0.564 

0.001 

0.836 

0.043 

0.016 

0.027 

0.147 

0.005 

0.415 

0.001 

0.726 

1.6 

0.036 

0.040 

0.021 

0.164 

0.003 

0.439 

0.000 

0.739 

0.012 

0.007 

0.010 

0.081 

0.003 

0.281 

0.001 

0.619 

2.0 

0.013 

0.024 

0.005 

0.112 

0.001 

0.341 


0.644 

0.004 

0.004 

0.002 

0.046 

0.000 

0.176 

0.000 

0.507 

2.4 

0.006 

0.015 

0.003 

0.070 

0.001 

0.239 


0.516 

0.000 

0.002 

0.000 

0.026 


0.100 


0.377 

2.8 

0.003 

0.007 

0.001 

0.043 

0.001 

0.158 


0.396 


0.001 


0.017 


0.054 


0.277 

3.2 

0.002 

0.004 

0.001 

0.028 

0.001 

0.107 


0.294 




0.010 


0.027 


0.192 

3.6 

0.000 

0.001 

0.000 

0.010 

0.001 

0.069 


0.216 




0.003 


0.019 


0.118 

4.0 


0.001 


0.005 

0.001 

0.047 


0.158 




0.001 


0.008 


0.078 



0.000 


0.002 

0.000 

0.026 


0.115 




0.000 


0.002 


0.044 





0.001 


0.017 


0.086 






0.001 


0.025 





0.000 


0.010 


0.057 






0.000 


0.015 







0.006 


0.039 








0.008 







0.003 


0.027 








0.003 







0.002 


0.016 








0.000 







0.002 


0.011 















0.000 


0.009 

















0.007 

















0.005 

















0.002 

















0.000 









n = 64 


n = 128 

B 

A 

= 1 

A 

= 2 

A 

= 3 

A 

= 4 

A 

= 1 

A 

= 2 

A 

- 3 

A 

= 4 

T 

P e 

P c 

p. 

P c 

p. 

P c 

p« 

P e 

P e 

P c 

P e 

P c 

P p 

P c 

P 

e 

P c 

0 . 

0.882 

0.118 

0.620 

0.380 

0.270 

0.730 

0.076 

0.924 

0.935 

0.065 

0.709 

0.291 

0.383 

0.617 

0.089 

0.911 

0.4 

0.329 

0.063 

0.229 

0.257 

0.082 

0.608 

0.033 

0.866 

0.337 

0.036 

0.233 

0.171 

0.121 

0.492 

0.023 

0.836 

0.8 

0.123 

0.028 

0.070 

0.153 

0.019 

0.456 

0.012 

0.790 

0.107 

0.013 

0.065 

0.095 

0.031 

0.346 

0.006 

0.713 

1.2 

0.042 

0.011 

0.016 

0.072 

0.006 

0.344 

0.006 

0.666 

0.032 

0.007 

0.015 

0.050 

0.004 

0.228 

0.004 

0.589 

1.6 

0.012 

0.001 

0.004 

0.037 

0.003 

0.217 

0.002 

0.525 

0.010 

0.004 

0.003 

0.020 

0.001 

0.133 

0.000 

0.462 

2.0 

0.007 

0.000 

0.001 

0.015 

0.002 

0.131 

0.000 

0.385 

0.004 

0.000 

0.001 

0.008 

0.001 

0.064 


0.323 

2.4 

0.002 


0.001 

0.004 

0.000 

0.073 


0.269 

0.002 


0.001 

0.002 

0.000 

0.030 


0.210 

2.8 

0.000 


0.000 

0.001 


0.039 


0.153 

0.000 


0.001 

0.001 


0.019 


0.128 

3.2 




0.000 


0.015 


0.086 



0.000 

0.000 


0.005 


0.064 

3.6 






0.005 


0.044 






0.002 


0.035 

4.0 






0.002 


0.026 






0.001 


0.018 







0.002 


0.012 






0.001 


0.003 







0.002 


0.004 






0.000 


0.001 







0.000 


0.002 








0.001 









0.001 








0.000 









0.000 
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Table E12 


Experimental Results, B fi Coherent. 



n = 16 

E3 

II 

CO 

CO 

B t 

■ 

m 

A = 

Bi 


m 

A 

= 4 

A 

= i 

A 

= 2 

A 

= 3 

A 

= 4 


D 


P e 










1 

ES 

P 

e 




0.260 

0.405 

0.595 

0.120 

0.880 

0.022 

0.978 

0.811 

0.189 


0.481 



0.050 

0.950 



0.182 

0.189 

0.473 

0.047 

0.787 

0.008 

0.950 

0.314 

0.101 

0.180 

0.322 

0.063 

0.665 

0.013 

0.882 

■ 


0.100 

0.085 

0.332 

0.013 

0.658 

0.001 

0.885 

0.074 

0.027 

0.045 

0.193 

0.013 

0.471 

0.001 

0.768 


0.041 


0.024 

0.174 

0.004 

0.458 

0.000 

0.751 

0.010 

0.005 


0.066 


0.227 

0.001 

0.563 

ESS 


0.017 

0.002 

0.073 

0.001 

0.239 


0.511 

0.000 

0.001 

0.000 

0.015 

0.000 

0.057 

0.000 

0.292 

0.5 


0.001 


0.012 

0.000 

0.078 


0.224 




0.002 




0.071 

mm 


0.000 

0.000 

0.000 


0.012 


0.052 




0.000 


0.000 


0.005 









0.002 








0.000 








1 











n - 64 

n = 128 




b t 

■ 

m 

m 

mm 

wm 

A 

= 3 

A 

= 4 

A 

= 1 

A 

= 2 

A 

= 3 

A 

= 4 




D 

D 


P 

C 

P 

e 




P e 

P 

C 


P c 

B 


0 . 

0.882 

0.118 

0.620 


0.270 

0.730 

0.076 

0.924 

0.935 

0.065 

0.709 

0.291 


0.617 


0.911 

0.1 

0.259 

0.050 

0.177 


0.055 

0.557 

0.021 

0.840 

0.221 

0.024 

0.114 

0.141 

0.072 

0.427 

0.017 

0.770 

0.2 

0.058 


0.028 


0.007 

0.357 

0.006 

0.671 

0.028 

0.005 

0.017 

0.041 

0.003 

0.207 


0.545 

0.3 

0.008 

0.001 


0.016 

0.001 

0.140 

0.001 

0.382 

0.003 

0.001 

0.002 

0.008 


0.051 


0.261 

0.4 

0.001 

0.000 

0.000 

0.000 

0.000 

0.024 

0.000 

0.114 

0.000 

0.000 

0.000 

0.000 

0.000 

0.003 


0.052 


0.000 













0.000 



0.6 






0.000 
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Table E13 


Experimental Results, Bj Noncoherent. 


n = 16 

n = 32 


B 

A 

= 1 

A 

2 

A 

= 3 

A 

= 4 

A 

= 1 

A 

= 2 

A 

3 

A 

4 

T 

P e 

P 

C 

p 

P c 

P e 

P c 

P e 

Pc 

P e 

P 

c 

P e 

P 

C 

P e 

P 

C 

P e 

P c 

0. 

0.853 

0.147 

0.620 

0.380 

0.254 

0.746 

0.071 

0.929 

0.908 

0.092 

0.701 

0.299 

0.363 

0.637 

0.118 

0.882 

0.4 

0.853 

0.147 

0.620 

0.380 

0.254 

0.746 

0.071 

0.929 

0.908 

0.092 

0.701 

0.299 

0.363 

0.637 

0.118 

0.882 

0.8 

0.853 

0.147 

0.620 

0.380 

0.254 

0.746 

0.071 

0.929 

0.908 

0.092 

0.701 

0.299 

0.363 

0.637 

0.118 

0.882 

1.2 

0.853 

0.147 

0.620 

0.380 

0.254 

0.746 

0.071 

0.929 

0.908 

0.092 

0.701 

0.299 

0.363 

0.637 

0.118 

0.882 

1.6 

0.845 

0.147 

0.617 

0.380 

0.253 

0.746 

0.071 

0.929 

0.908 

0.092 

0.701 

0.299 

0.363 

0.637 

0.118 

0.882 

2.0 

0.780 

0.137 

0.583 

0.376 

0.243 

0.742 

0.070 

0.928 

0.896 

0.092 

0.698 

0.299 

0.362 

0.637 

0.118 

0.882 

2.4 

0.522 

0.110 

0.439 

0.335 

0.205 

0.714 

0.065 

0.920 

0.768 

0.083 

0.622 

0.283 

0.343 

0.629 

0.110 

0.880 

2.8 

0.224 

0.064 

0.220 

0.243 

0.127 

0.623 

0.043 

0.894 

0.413 

0.050 

0.380 

0.236 

0.231 

0.572 

0.091 

0.862 

3.2 

0.075 

0.027 

0.086 

0.136 

0.062 

0.488 

0.020 

0.819 

0.147 

0.023 

0.156 

0.151 

0.107 

0.463 

0.051 

0.796 

3.6 

0.018 

0.012 

0.024 

0.074 

0.023 

0.332 

0.008 

0.697 

0.033 

0.005 

0.046 

0.087 

0.029 

0.314 

0.023 

0.687 

4.0 

0.002 

0.005 

0.008 

0.025 

0.007 

0.202 

0.000 

0.542 

0.009 

0.002 

0.013 

0.034 

0.006 

0.170 

0.004 

0.545 

4.4 

0.000 

0.002 

0.000 

0.009 

0.002 

0.110 

0.000 

0.373 

0.002 

0.001 

0.004 

0.016 

0.002 

0.095 

0.003 

0.400 

4.8 


0.000 


0.002 


0.052 


0.238 

0.000 

0.000 

0.001 

0.006 

0.000 

0.044 

0.000 

0.247 

5.2 




0.000 


0.026 


0.137 



0.000 

0.003 


0.019 


0.139 

5.6 






0.010 


0.064 




0.001 


0.007 


0.074 

6.0 






0.003 


0.029 




0.000 


0.004 


0.039 

6.4 






0.001 


0.012 






0.001 


0.010 

6.8 






0.000 


0.003 






0.000 


0.005 

7.2 








0.000 








0.001 

n = 64 

n = 128 

B T 

A 

= 1 

A 

= 2 

A 

= 3 

A 

= 4 

A 

= 1 

A 

= 2 

A 

= 3 

A 

= 4 

P e 

P c 

P e 

Pc 

P e 

P c 

p . 

P c 

p 

Pc 

P e 

P c 

P e 

P c 

p . 

Pc 

0. 

0.945 

0.055 

0.795 

0.205 

0.448 

0.552 

0.165 

0.835 

0.977 

0.023 

0.844 

0.156 

0.565 

0.435 

0.184 

0.816 

0.4 

0.945 

0.055 

0.795 

0.205 

0.448 

0.552 

0.165 

0.835 

0.977 

0.023 

0.844 

0.156 

0.565 

0.435 

0.184 

0.816 

0.8 

0.945 

0.055 

0.795 

0.205 

0.448 

0.552 

0.165 

0.835 

0.977 

0.023 

0.844 

0.156 

0.565 

0.435 

0.184 

0.816 

1.2 

0.045 

0.055 

0.795 

0.205 

0.448 

0.552 

0.165 

0.835 

0.977 

0.023 

0.844 

0.156 

0.565 

0.435 

0.184 

0.816 

1.6 

0.945 

0.055 

0.795 

0.205 

0.448 

0.552 

0.165 

0.835 

0.977 

0.023 

0.844 

0.156 

0.565 

0.435 

0.184 

0.816 

2.0 

0.945 

0.055 

0.794 

0.205 

0.448 

0.552 

0.165 

0.835 

0.977 

0.023 

0.844 

0.156 

0.565 

0.435 

0.184 

0.816 

2.4 

0.927 

0.054 

0.777 

0.203 

0.440 

0.552 

0.163 

0.835 

0.976 

0.023 

0.844 

0.156 

0.565 

0.435 

0.184 

0.816 

2.8 

0.690 

0.048 

0.584 

0.184 

0.356 

0.526 

0.147 

0.828 

0.908 

0.022 

0.777 

0.153 

0.540 

0.433 

0.177 

0.815 

3.2 

0.302 

0.027 

0.258 

0.120 

0.193 

0.446 

0.087 

0.791 

0.571 

0.017 

0.452 

0.127 

0.361 

0.392 

0.125 

0.796 

3.6 

0.097 

0.014 

0.067 

0.069 

0.072 

0.317 

0.040 

0.678 

0.196 

0.007 

0.157 

0.074 

0.137 

0.282 

0.061 

0.697 

4.0 

0.018 

0.006 

0.015 

0.022 

0.027 

0.194 

0.008 

0.543 

0.045 

0.002 

0.040 

0.037 

0.028 

0.176 

0.025 

0.570 

4.4 

0.004 

0.000 

0.004 

0.004 

0.006 

0.109 

0.000 

0.398 

0.012 

0.001 

0.007 

0.010 

0.013 

0.088 

0.005 

0.432 

4.8 

0.001 


0.000 

0.001 

0.000 

0.048 


0.234 

0.004 

0.000 

0.000 

0.004 

0.000 

0.029 

0.001 

0.275 

5.2 




0.000 


0.018 


0.121 

0.002 



0.000 


0.014 

0.000 

0.159 

5.6 






0.007 


0.049 

0.000 





0.008 


0.094 

6.0 






0.005 


0.019 






0.003 


0.045 

6.4 






0.001 


0.005 






0.002 


0.017 

6.8 






0.000 


0.001 






0.000 


0.009 









0.000 








0.002 

















0.000 
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Table E14 


Experimental Results, B 2 Noncoherent. 




n = 16 

n = 32 



m 


mm 

Hi 

■ 

■■ 

mm 

A 

= 4 

A 

= 1 

A 

= 2 


m 

A 

= 4 






P e 

Pc 


P c 

p . 

P c 

p . 







0.853 

0.147 

0.620 

0.380 

0.254 

0.746 

0.071 

0.929 

0.908 

0.092 

0.701 






Rif 

0.852 

0.147 

0.620 

0.380 

0.254 

0.746 

0.071 

0.929 

0.908 

0.092 

0.701 

0.299 

0.363 


0.118 

0.882 

iU 

0.811 

0.140 

0.600 

0.379 

0.246 

0.746 

0.070 

0.928 

0.906 

0.092 

0.700 

0.299 

0.363 


0.118 

0.882 

19 

0.534 

0.110 

0.447 

0.336 

0.195 

0.712 

0.062 

0.921 

0.772 

0.086 

0.628 

0.288 

0.338 

0.628 

0.111 

0.879 

iHfl 

0.227 

0.058 

0.200 

0.240 

0.114 

0.622 

0.042 

0.885 

0.394 


0.356 

0.229 

0.208 

0.560 

0.087 

0.857 

2.0 

0.075 

0.027 

0.069 

0.134 

0.048 

0.472 

0.016 

0.804 

0.131 

0.017 

0.140 

0.143 


0.444 


0.773 

2.4 

0.018 

0.012 

0.019 

0.068 

0.016 

0.311 


0.688 

0.030 


0.041 




0.018 

0.665 

2.8 

0.003 

0.004 

0.004 

0.028 


0.193 

0.000 

0.512 

0.008 

mm 

0.010 

0.031 

0.006 

0.164 


0.524 

3.2 

0.001 

0.001 

0.000 

0.009 

0.000 



0.359 

0.002 




0.000 


0.003 

0.367 

3.6 

0.000 

0.000 


0.003 


0.052 


0.227 

0.000 

0.000 


0.005 


0.041 

0.000 

0.237 





0.001 


0.022 


0.132 

M 



0.001 


0.016 


0.123 





0.000 




0.059 






0.009 


0.067 







0.003 


0.028 






0.001 


0.032 















0.001 


0.010 







0.000 



1 1 







0.004 









0.000 

■ 







0.001 

















0.000 


n = 64 

n = 128 




B t 

A 

= 1 

A 

= 2 

A 

= 3 

■ 

= 4 

A 

= 1 

A 

2 

A 

= 3 

A 

= 4 


P 

e 

P c 

P e 

Pc 

p . 

Pc 

a 

Pc 

p . 

P c 

p . 






0. 

0.945 

0.055 

0.795 

0.205 

0.448 

0.552 


0.835 

0.977 

0.023 

0.844 

0.156 

0.565 

0.435 

0.184 

0.816 

0.4 

0.945 

0.055 

0.795 

0.205 

0.448 

0.552 


0.835 

0.977 

0.023 

0.844 

0.156 

0.565 

0.435 

0.184 

0.816 

0.8 

0.945 

0.055 

0.795 

0.205 

0.448 

0.552 

0.165 

0.835 

0.977 

0.023 

0.844 

0.156 

0.565 

0.435 

0.184 

0.816 

1.2 

0.928 

0.054 

0.782 

0.203 

0.441 

0.551 

0.164 

0.835 

0.977 

0.023 

0.844 

0.156 

0.565 

0.435 

0.184 

0.816 

1.6 

0.671 

0.047 

0.557 

0.181 

0.340 


0.138 

0.827 

0.895 

0.022 

0.763 

0.152 

0.536 

0.433 

0.173 

0.814 

2.0 

0.273 

0.026 

0.226 

0.120 

0.169 

0.438 


0.778 

0.519 

0.018 

0.397 

0.121 

0.326 

0.379 

0.114 

0.786 

2.4 

0.084 

0.011 

0.055 

0.059 

0.059 

0.308 


0.652 

0.172 

0.006 

0.138 

0.069 

0.116 

0.275 

0.053 

0.688 

2.8 

0.019 

0.003 

0.012 

0.019 

0.019 

0.183 

0.006 

0.534 

0.034 

0.002 

0.030 

0.034 
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Table E15 


Experimental Results, B Noncoherent. 
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Experimental Results, B 4 Noncoherent. 



67 






















Table E17 

Experimental Results, B s Noncoherent. 
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Experimental Results, B fi Noncoherent. 
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Figure E8— P vs. P e for B, coherent (experimental). 
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